[ 496.988655] env[62842]: INFO neutron.common.config [-] Logging enabled! [ 496.989157] env[62842]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev16 [ 496.989157] env[62842]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=62842) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 496.989402] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 496.989499] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 496.990342] env[62842]: WARNING oslo_policy.policy [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 496.990554] env[62842]: WARNING oslo_policy.policy [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 496.992088] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] VMware NSXv3 Agent initialized successfully. [ 496.992455] env[62842]: DEBUG oslo_concurrency.lockutils [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] Acquiring lock "singleton_lock" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 496.992592] env[62842]: DEBUG oslo_concurrency.lockutils [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] Acquired lock "singleton_lock" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 496.992806] env[62842]: DEBUG oslo_concurrency.lockutils [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] Releasing lock "singleton_lock" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 496.993097] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] Full set of CONF: {{(pid=62842) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/eventlet/service.py:357}} [ 496.993314] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] ******************************************************************************** {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 496.993437] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] Configuration options gathered from: {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 496.993683] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 496.993856] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 496.993963] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] ================================================================================ {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 496.994153] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] agent_down_time = 75 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 496.994332] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] allow_automatic_dhcp_failover = True {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 496.994493] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] allow_bulk = True {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 496.994650] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] api_extensions_path = {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 496.994796] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] api_paste_config = api-paste.ini {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 496.994973] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] auth_strategy = keystone {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 496.995063] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] backdoor_port = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 496.995174] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] backdoor_socket = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 496.995320] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] backlog = 4096 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 496.995459] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] base_mac = fa:16:3e:00:00:00 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 496.995625] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] bind_host = 0.0.0.0 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 496.995775] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] bind_port = 9696 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 496.995919] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] client_socket_timeout = 900 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 496.996076] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] config_dir = [] {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 496.996195] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 496.996371] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] config_source = [] {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 496.996529] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] control_exchange = neutron {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 496.996676] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] core_plugin = ml2 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 496.996822] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] debug = True {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 496.996965] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] default_availability_zones = [] {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 496.997190] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 496.997339] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] dhcp_agent_notification = True {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 496.997502] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] dhcp_agents_per_network = 1 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 496.997645] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] dhcp_lease_duration = 86400 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 496.997797] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] dhcp_load_type = networks {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 496.997942] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] dns_domain = openstacklocal {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 496.998097] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 496.998239] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] enable_default_route_bfd = False {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 496.998385] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] enable_default_route_ecmp = False {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 496.998516] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] enable_dvr = True {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 496.998653] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] enable_new_agents = True {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 496.998789] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 496.998925] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] enable_signals = True {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 496.999075] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] enable_traditional_dhcp = True {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 496.999210] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] external_dns_driver = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 496.999365] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] filter_validation = True {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 496.999492] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] global_physnet_mtu = 8950 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 496.999634] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] graceful_shutdown_timeout = 60 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.000042] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] host = cpu-1 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.000042] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] host_dvr_for_dhcp = True {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.000174] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] http_retries = 3 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.000250] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] instance_format = [instance: %(uuid)s] {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.000390] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.000549] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] ipam_driver = internal {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.000675] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] ipv6_pd_enabled = False {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.000813] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] l3_ha = False {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.000955] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.001110] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] l3_ha_network_physical_name = {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.001254] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] l3_ha_network_type = {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.001399] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] log_color = False {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.001541] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] log_config_append = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.001684] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.001820] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] log_dir = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.001955] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] log_file = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.002080] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] log_options = True {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.002227] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] log_rotate_interval = 1 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.002375] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] log_rotate_interval_type = days {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.002560] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] log_rotation_type = none {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.002626] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.002736] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.002881] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.003035] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.003149] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.003291] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] max_dns_nameservers = 5 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.003432] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] max_header_line = 16384 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.003571] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] max_l3_agents_per_router = 3 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.003712] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] max_logfile_count = 30 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.003851] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] max_logfile_size_mb = 200 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.003991] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] max_subnet_host_routes = 20 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.004150] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] my_ip = 10.180.1.21 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.004324] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] my_ipv6 = ::1 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.004477] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] network_auto_schedule = True {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.004614] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] network_link_prefix = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.004761] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.004908] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] notify_nova_on_port_data_changes = True {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.005063] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] notify_nova_on_port_status_changes = True {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.005211] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] pagination_max_limit = -1 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.005364] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] publish_errors = False {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.005486] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] rate_limit_burst = 0 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.005649] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] rate_limit_except_level = CRITICAL {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.005769] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] rate_limit_interval = 0 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.005908] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] retry_until_window = 30 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.006073] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] router_distributed = False {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.006219] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] rpc_resources_processing_step = 20 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.006389] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] rpc_response_max_timeout = 600 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.006535] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] rpc_response_timeout = 60 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.006677] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] send_events_interval = 2 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.006834] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] service_plugins = ['router'] {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.006979] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] setproctitle = on {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.007128] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] shell_completion = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.007275] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] state_path = /opt/stack/data/neutron {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.007440] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] syslog_log_facility = LOG_USER {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.007594] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] tcp_keepidle = 600 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.007738] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] transport_url = **** {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.007877] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] use_journal = False {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.008023] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] use_json = False {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.008163] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] use_ssl = False {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.008301] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] use_stderr = False {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.008447] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] use_syslog = False {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.008586] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] vlan_qinq = False {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.008895] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] vlan_transparent = False {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.008895] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] watch_log_file = False {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.009026] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] wsgi_default_pool_size = 100 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.009126] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] wsgi_keep_alive = True {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.009268] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.009408] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] wsgi_server_debug = False {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 497.009563] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_concurrency.disable_process_locking = False {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.009711] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.009859] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.010007] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.010157] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.010304] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.010452] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.010600] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] profiler.connection_string = messaging:// {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.010750] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] profiler.enabled = False {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.010960] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] profiler.es_doc_type = notification {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.011131] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] profiler.es_scroll_size = 10000 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.011285] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] profiler.es_scroll_time = 2m {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.011428] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] profiler.filter_error_trace = False {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.011573] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] profiler.hmac_keys = **** {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.011720] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] profiler.sentinel_service_name = mymaster {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.011872] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] profiler.socket_timeout = 0.1 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.012029] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] profiler.trace_requests = False {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.012165] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] profiler.trace_sqlalchemy = False {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.012321] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] profiler_jaeger.process_tags = {} {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.012461] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] profiler_jaeger.service_name_prefix = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.012601] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] profiler_otlp.service_name_prefix = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.012757] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_policy.enforce_new_defaults = True {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.013299] env[62842]: WARNING oslo_config.cfg [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 497.013472] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_policy.enforce_scope = True {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.013627] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_policy.policy_default_rule = default {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.013787] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.013935] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.014099] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.014239] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.014396] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.014538] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.014681] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.014830] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_policy.remote_timeout = 60.0 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.014985] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.015149] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] agent.extensions = [] {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.015297] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.015445] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] service_providers.service_provider = [] {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.015598] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] QUOTAS.default_quota = -1 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.015745] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.015890] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] QUOTAS.quota_floatingip = 50 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.016045] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] QUOTAS.quota_network = 100 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.016191] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] QUOTAS.quota_port = 500 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.016353] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.016504] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] QUOTAS.quota_router = 10 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.016648] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] QUOTAS.quota_security_group = 10 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.016793] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.016934] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] QUOTAS.quota_subnet = 100 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.017087] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] QUOTAS.track_quota_usage = True {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.017243] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.017399] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] privsep.group = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.017553] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] privsep.helper_command = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.017703] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.017847] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] privsep.thread_pool_size = 8 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.017988] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] privsep.user = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.018155] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.018292] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] privsep_dhcp_release.group = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.018430] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] privsep_dhcp_release.helper_command = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.018572] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.018714] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.018848] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] privsep_dhcp_release.user = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.018994] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.019145] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] privsep_ovs_vsctl.group = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.019282] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] privsep_ovs_vsctl.helper_command = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.019458] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.019560] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.019695] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] privsep_ovs_vsctl.user = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.019840] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] privsep_namespace.capabilities = [21] {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.019977] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] privsep_namespace.group = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.020126] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] privsep_namespace.helper_command = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.020265] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.020422] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] privsep_namespace.thread_pool_size = 8 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.020539] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] privsep_namespace.user = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.020694] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] privsep_conntrack.capabilities = [12] {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.020830] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] privsep_conntrack.group = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.020966] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] privsep_conntrack.helper_command = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.021120] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.021264] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.021400] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] privsep_conntrack.user = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.021551] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] privsep_link.capabilities = [12, 21] {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.021689] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] privsep_link.group = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.021823] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] privsep_link.helper_command = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.021967] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.022125] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] privsep_link.thread_pool_size = 8 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.022260] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] privsep_link.user = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.022418] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.022573] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.022719] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] AGENT.continue_on_failed_promotions = False {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.022860] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] AGENT.dscp = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.023010] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] AGENT.dscp_inherit = False {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.023164] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] AGENT.force_mp_to_policy = True {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.023304] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] AGENT.locking_coordinator_url = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.023449] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] AGENT.log_agent_heartbeats = False {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.023640] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] AGENT.logging_expire = 1 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.023827] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.024025] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.024230] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] AGENT.polling_interval = 240 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.024408] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.024570] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.024726] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] AGENT.report_interval = 30.0 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.024876] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.025034] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.025192] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.025338] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] AGENT.sync_skew = 60 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.025484] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] AGENT.synchronization_queue_size = 20 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.025631] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] AGENT.use_helper_for_ns_read = True {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.025779] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] SECURITYGROUP.enable_ipset = True {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.025927] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] SECURITYGROUP.enable_security_group = True {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.026084] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.026235] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.026401] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] experimental.ipv6_pd_enabled = False {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.026571] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] ml2.extension_drivers = ['port_security'] {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.026724] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] ml2.external_network_type = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.026897] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.027065] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] ml2.overlay_ip_version = 4 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.027219] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] ml2.path_mtu = 8950 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.027391] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] ml2.physical_network_mtus = {} {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.027532] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] ml2.tenant_network_types = ['vlan'] {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.027682] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.027831] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] ml2.type_drivers = ['vlan'] {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.027982] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] AGENT_CLI.neutron_port_id = [] {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.028138] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.028283] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.028480] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.028596] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.028744] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.028893] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.029052] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.029203] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.029414] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.029568] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] NSXV3.nsxv3_login_password = **** {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.029722] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] NSXV3.nsxv3_login_port = 443 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.029868] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] NSXV3.nsxv3_login_user = admin {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.030025] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.030181] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.030325] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.030470] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.030621] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.030771] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.030920] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.031081] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.031228] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.031377] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.031530] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.031672] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.031819] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.032648] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.032648] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] vsphere.vsphere_login_password = VMware1! {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.032648] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.032648] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.032648] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] nova.auth_section = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.032833] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] nova.auth_type = password {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.032980] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.033155] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] nova.certfile = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.033559] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] nova.collect_timing = False {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.033559] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] nova.endpoint_type = public {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.033683] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] nova.insecure = False {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.033748] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] nova.keyfile = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.033910] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] nova.region_name = RegionOne {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.034067] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] nova.split_loggers = False {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.034213] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] nova.timeout = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.034362] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] placement.auth_section = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.034519] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] placement.auth_type = password {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.034668] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.034807] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] placement.certfile = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.034951] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] placement.collect_timing = False {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.035112] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] placement.endpoint_type = public {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.035255] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] placement.insecure = False {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.035392] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] placement.keyfile = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.035529] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] placement.region_name = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.035670] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] placement.split_loggers = False {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.035807] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] placement.timeout = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.035952] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] ironic.auth_section = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.036104] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] ironic.auth_type = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.036245] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] ironic.cafile = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.036411] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] ironic.certfile = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.036562] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] ironic.collect_timing = False {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.036708] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] ironic.connect_retries = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.036845] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] ironic.connect_retry_delay = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.036989] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] ironic.enable_notifications = False {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.037141] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] ironic.endpoint_override = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.037289] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] ironic.insecure = False {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.037429] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] ironic.interface = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.037567] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] ironic.keyfile = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.037705] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] ironic.max_version = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.037840] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] ironic.min_version = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.037975] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] ironic.region_name = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.038123] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] ironic.retriable_status_codes = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.038260] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] ironic.service_name = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.038396] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] ironic.service_type = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.038545] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] ironic.split_loggers = False {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.038698] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] ironic.status_code_retries = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.038840] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] ironic.status_code_retry_delay = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.038978] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] ironic.timeout = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.039127] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] ironic.valid_interfaces = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.039267] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] ironic.version = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.039413] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] cli_script.dry_run = False {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.039568] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.039711] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.039853] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.040165] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.040165] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.040268] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.040409] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.040551] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.040699] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.040845] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.040985] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.041144] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.041293] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.041441] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.041584] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.041733] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.041874] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.042027] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.042178] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.042325] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.042471] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.042616] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.042763] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.042906] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.043059] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.043205] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.043348] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.043490] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.043631] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.043774] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.043916] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_messaging_rabbit.ssl = False {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.044074] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.044223] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.044389] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.044545] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.044697] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_messaging_rabbit.ssl_version = {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.044844] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.045010] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_messaging_notifications.driver = [] {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.045162] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_messaging_notifications.retry = -1 {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.045327] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.045472] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] oslo_messaging_notifications.transport_url = **** {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 497.045584] env[62842]: DEBUG oslo_service.backend.eventlet.service [None req-b6716588-6635-4ed3-9371-0894e35a8b11 None None] ******************************************************************************** {{(pid=62842) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 497.046665] env[62842]: DEBUG neutron.agent.securitygroups_rpc [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Init firewall settings (driver=nsxv3) {{(pid=62842) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 497.047968] env[62842]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=62842) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 497.048226] env[62842]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] RPC agent_id: nsxm-l-01a.corp.local [ 497.050534] env[62842]: DEBUG dogpile.cache.region [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 497.050651] env[62842]: DEBUG dogpile.lock [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 497.050751] env[62842]: DEBUG dogpile.lock [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 497.050844] env[62842]: DEBUG dogpile.lock [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 497.050936] env[62842]: DEBUG dogpile.cache.region [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 497.051034] env[62842]: DEBUG dogpile.lock [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 497.051163] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 497.081044] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Session token - acquiring [ 497.082549] env[62842]: DEBUG networking_nsxv3.common.locking [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 497.082728] env[62842]: DEBUG oslo_concurrency.lockutils [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 497.082836] env[62842]: DEBUG oslo_concurrency.lockutils [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 497.083321] env[62842]: DEBUG oslo_concurrency.lockutils [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 497.095543] env[62842]: DEBUG oslo_concurrency.lockutils [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 497.386959] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 497.409742] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 497.409901] env[62842]: DEBUG dogpile.cache.region [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Cache value generated in 0.359 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 497.410042] env[62842]: DEBUG dogpile.lock [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 497.410138] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Activating Policy API Provider. [ 497.410341] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Looking for the default Infrastructure Rules. [ 497.486212] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Looking for the Default Layer3 Logged Drop Section. [ 497.502274] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 497.502783] env[62842]: DEBUG networking_nsxv3.common.locking [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 497.502964] env[62842]: DEBUG oslo_concurrency.lockutils [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Acquiring lock "all" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 497.503094] env[62842]: DEBUG oslo_concurrency.lockutils [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Acquired lock "all" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 497.503396] env[62842]: DEBUG oslo_concurrency.lockutils [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Acquired external semaphore "all" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 497.503739] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 498.019600] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 498.522867] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 499.025181] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Inventory metadata is going to be refreshed. [ 499.025583] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 499.752971] env[62842]: DEBUG networking_nsxv3.common.locking [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 499.753250] env[62842]: DEBUG oslo_concurrency.lockutils [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 499.753304] env[62842]: DEBUG oslo_concurrency.lockutils [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 499.753591] env[62842]: DEBUG oslo_concurrency.lockutils [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 499.769348] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 499.884052] env[62842]: DEBUG oslo_concurrency.lockutils [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 499.885134] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 499.903332] env[62842]: DEBUG networking_nsxv3.common.locking [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 499.903608] env[62842]: DEBUG oslo_concurrency.lockutils [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 499.903669] env[62842]: DEBUG oslo_concurrency.lockutils [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 499.903982] env[62842]: DEBUG oslo_concurrency.lockutils [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 499.904127] env[62842]: DEBUG oslo_concurrency.lockutils [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 499.904293] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 499.904403] env[62842]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=62842) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 499.904508] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 499.925660] env[62842]: DEBUG networking_nsxv3.common.locking [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 499.925896] env[62842]: DEBUG oslo_concurrency.lockutils [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 499.925943] env[62842]: DEBUG oslo_concurrency.lockutils [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 499.926296] env[62842]: DEBUG oslo_concurrency.lockutils [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 499.926514] env[62842]: DEBUG oslo_concurrency.lockutils [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 499.926670] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 499.954517] env[62842]: DEBUG networking_nsxv3.common.locking [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 499.954820] env[62842]: DEBUG oslo_concurrency.lockutils [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 499.954869] env[62842]: DEBUG oslo_concurrency.lockutils [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 499.955267] env[62842]: DEBUG oslo_concurrency.lockutils [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 499.955451] env[62842]: DEBUG oslo_concurrency.lockutils [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 499.955629] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 499.977014] env[62842]: DEBUG networking_nsxv3.common.locking [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 499.977334] env[62842]: DEBUG oslo_concurrency.lockutils [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Acquiring lock "Address Group" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 499.977393] env[62842]: DEBUG oslo_concurrency.lockutils [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Acquired lock "Address Group" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 499.977736] env[62842]: DEBUG oslo_concurrency.lockutils [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Acquired external semaphore "Address Group" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 499.977885] env[62842]: DEBUG oslo_concurrency.lockutils [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Releasing lock "Address Group" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 499.978072] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 499.978185] env[62842]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=62842) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 499.978303] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 499.998191] env[62842]: DEBUG networking_nsxv3.common.locking [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 499.998435] env[62842]: DEBUG oslo_concurrency.lockutils [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Acquiring lock "Segment QoS" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 499.998487] env[62842]: DEBUG oslo_concurrency.lockutils [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Acquired lock "Segment QoS" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 499.998792] env[62842]: DEBUG oslo_concurrency.lockutils [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Acquired external semaphore "Segment QoS" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 499.998921] env[62842]: DEBUG oslo_concurrency.lockutils [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Releasing lock "Segment QoS" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 499.999080] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 499.999186] env[62842]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=62842) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 499.999291] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 500.023124] env[62842]: DEBUG networking_nsxv3.common.locking [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 500.023370] env[62842]: DEBUG oslo_concurrency.lockutils [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 500.023370] env[62842]: DEBUG oslo_concurrency.lockutils [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 500.023632] env[62842]: DEBUG oslo_concurrency.lockutils [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 500.023775] env[62842]: DEBUG oslo_concurrency.lockutils [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 500.023951] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 500.024099] env[62842]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=62842) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 500.024231] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Inventory metadata have been refreshed. [ 500.024405] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Dryrun:True. Metadata refresh completed. [ 500.024530] env[62842]: DEBUG oslo_concurrency.lockutils [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Releasing lock "all" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 500.026364] env[62842]: INFO neutron.agent.agent_extensions_manager [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Loaded agent extensions: [] [ 500.027021] env[62842]: DEBUG neutron_lib.callbacks.manager [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=62842) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 500.076992] env[62842]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] NSXv3 Agent Agent RPC Daemon Started! [ 500.077168] env[62842]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] NSXv3 Agent Agent loop - iteration:0 started [ 500.077221] env[62842]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] NSXv3 Agent Agent out of sync with plugin! [ 505.027094] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 505.027494] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 510.028393] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 510.028759] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 514.140424] env[62842]: INFO networking_nsxv3.common.synchronization [None req-0c7c2c68-fc1b-4b44-8032-bb533620f744 demo admin] Enqueued Resource ID: 34879d8b-9fb0-4c2a-9988-48e460b4d860 with Priority: HIGHEST for action security_group_rules [ 514.141123] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34879d8b-9fb0-4c2a-9988-48e460b4d860 with Priority: HIGHEST for action security_group_rules [ 514.141490] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34879d8b-9fb0-4c2a-9988-48e460b4d860 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 514.141659] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34879d8b-9fb0-4c2a-9988-48e460b4d860" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 514.141774] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34879d8b-9fb0-4c2a-9988-48e460b4d860" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 514.142237] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34879d8b-9fb0-4c2a-9988-48e460b4d860" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 514.142379] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34879d8b-9fb0-4c2a-9988-48e460b4d860',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 514.664123] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 514.664427] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 514.664427] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 514.664597] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 514.664597] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 514.664744] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34879d8b-9fb0-4c2a-9988-48e460b4d860 already deleted. [ 514.664744] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34879d8b-9fb0-4c2a-9988-48e460b4d860" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 519.142145] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 519.142145] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 522.030011] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 522.030483] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 522.030483] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 522.030600] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 522.030744] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 522.533789] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 523.036634] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 523.539852] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 523.539852] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 524.143508] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 524.143508] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 524.263638] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 524.264014] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 524.265028] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 524.265028] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 524.277024] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 524.278040] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 524.278816] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 524.298331] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 524.298706] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 524.298896] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 524.299315] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 524.300847] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 524.300847] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 524.300847] env[62842]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=62842) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 524.300847] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 524.319683] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 524.319683] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 524.319683] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 524.319683] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 524.319948] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 524.319948] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 524.338303] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 524.338656] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 524.338854] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 524.339159] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 524.340024] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 524.340024] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 524.359418] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 524.359754] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 524.359928] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 524.360223] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 524.360423] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 524.360635] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 524.360800] env[62842]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=62842) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 524.360978] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 524.377806] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 524.377806] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 524.378049] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 524.378084] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 524.378161] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 524.379018] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 524.379018] env[62842]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=62842) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 524.379018] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 524.397983] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 524.398209] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 524.398209] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 524.398323] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 524.398403] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 524.398517] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 524.398590] env[62842]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=62842) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 524.398671] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 524.398734] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 524.398788] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 524.398840] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 524.398896] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 524.399153] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 524.399219] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 524.399287] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 524.417358] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 524.417544] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 524.417544] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 524.417733] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 524.417836] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 524.417942] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 524.435596] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 524.435764] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 524.435809] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 524.435965] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 524.436078] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 524.449539] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 529.144133] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 529.144902] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 534.147025] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 534.147025] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 539.146683] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 539.147511] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 539.342102] env[62842]: INFO networking_nsxv3.common.synchronization [None req-c47aa0bb-e278-4d4f-97a8-30297fbf372c None None] Enqueued Resource ID: 237fccb0-e86a-44da-aa28-6eba403f5139 with Priority: HIGHEST for action port [ 539.342102] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 237fccb0-e86a-44da-aa28-6eba403f5139 with Priority: HIGHEST for action port [ 539.342102] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-237fccb0-e86a-44da-aa28-6eba403f5139 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 539.342102] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-237fccb0-e86a-44da-aa28-6eba403f5139" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 539.342102] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-237fccb0-e86a-44da-aa28-6eba403f5139" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 539.342102] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-237fccb0-e86a-44da-aa28-6eba403f5139" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 539.342675] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('237fccb0-e86a-44da-aa28-6eba403f5139',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 539.851386] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 237fccb0-e86a-44da-aa28-6eba403f5139 [ 539.851386] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 539.851386] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 539.851386] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 539.851386] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 539.851386] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 539.851386] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:237fccb0-e86a-44da-aa28-6eba403f5139 already deleted. [ 539.851386] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-237fccb0-e86a-44da-aa28-6eba403f5139" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 541.200021] env[62842]: INFO networking_nsxv3.common.synchronization [None req-389a21ff-493c-464b-b8dd-e83dd7571fc7 None None] Enqueued Resource ID: 29cc906d-c3df-46af-852d-8ea12ec6333c with Priority: HIGHEST for action port [ 541.200021] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29cc906d-c3df-46af-852d-8ea12ec6333c with Priority: HIGHEST for action port [ 541.200021] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-29cc906d-c3df-46af-852d-8ea12ec6333c taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 541.200021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-29cc906d-c3df-46af-852d-8ea12ec6333c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 541.200021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-29cc906d-c3df-46af-852d-8ea12ec6333c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 541.201052] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-29cc906d-c3df-46af-852d-8ea12ec6333c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 541.201327] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29cc906d-c3df-46af-852d-8ea12ec6333c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 541.703170] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 29cc906d-c3df-46af-852d-8ea12ec6333c [ 541.703427] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 541.703658] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 541.703658] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 541.704822] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 541.704822] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 541.704822] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:29cc906d-c3df-46af-852d-8ea12ec6333c already deleted. [ 541.704822] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-29cc906d-c3df-46af-852d-8ea12ec6333c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 544.089735] env[62842]: INFO networking_nsxv3.common.synchronization [None req-b013c772-35fa-4aa5-926d-0eee79377083 None None] Enqueued Resource ID: 1bb8c8ed-deb1-49de-a7fb-04c459c4e91f with Priority: HIGHEST for action port [ 544.090034] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bb8c8ed-deb1-49de-a7fb-04c459c4e91f with Priority: HIGHEST for action port [ 544.090646] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-1bb8c8ed-deb1-49de-a7fb-04c459c4e91f taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 544.090773] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1bb8c8ed-deb1-49de-a7fb-04c459c4e91f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 544.090843] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1bb8c8ed-deb1-49de-a7fb-04c459c4e91f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 544.092566] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1bb8c8ed-deb1-49de-a7fb-04c459c4e91f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 544.092566] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1bb8c8ed-deb1-49de-a7fb-04c459c4e91f',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 544.595253] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1bb8c8ed-deb1-49de-a7fb-04c459c4e91f [ 544.595588] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 544.600458] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 544.600458] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 544.600583] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 544.602154] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 544.602154] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1bb8c8ed-deb1-49de-a7fb-04c459c4e91f already deleted. [ 544.602279] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1bb8c8ed-deb1-49de-a7fb-04c459c4e91f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 545.269958] env[62842]: INFO networking_nsxv3.common.synchronization [None req-f99f6d87-2fb3-4be9-a800-63a4ea29868c None None] Enqueued Resource ID: 87debdf0-b0d2-49f1-a066-e530b5f3fdd3 with Priority: HIGHEST for action port [ 545.270542] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87debdf0-b0d2-49f1-a066-e530b5f3fdd3 with Priority: HIGHEST for action port [ 545.270902] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-87debdf0-b0d2-49f1-a066-e530b5f3fdd3 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 545.270968] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-87debdf0-b0d2-49f1-a066-e530b5f3fdd3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 545.272527] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-87debdf0-b0d2-49f1-a066-e530b5f3fdd3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 545.272953] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-87debdf0-b0d2-49f1-a066-e530b5f3fdd3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 545.273824] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('87debdf0-b0d2-49f1-a066-e530b5f3fdd3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 545.776427] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 87debdf0-b0d2-49f1-a066-e530b5f3fdd3 [ 545.776676] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 545.776860] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 545.776860] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 545.779234] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 545.779768] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 545.779768] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:87debdf0-b0d2-49f1-a066-e530b5f3fdd3 already deleted. [ 545.779768] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-87debdf0-b0d2-49f1-a066-e530b5f3fdd3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 545.943036] env[62842]: INFO networking_nsxv3.common.synchronization [None req-df1ffaf6-47c9-4d17-9b47-95dd99499639 None None] Enqueued Resource ID: 4b68df9f-6bb6-4d2a-ab38-c8f2a96aff65 with Priority: HIGHEST for action port [ 545.944941] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b68df9f-6bb6-4d2a-ab38-c8f2a96aff65 with Priority: HIGHEST for action port [ 545.944941] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b68df9f-6bb6-4d2a-ab38-c8f2a96aff65 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 545.944941] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b68df9f-6bb6-4d2a-ab38-c8f2a96aff65" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 545.944941] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b68df9f-6bb6-4d2a-ab38-c8f2a96aff65" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 545.944941] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b68df9f-6bb6-4d2a-ab38-c8f2a96aff65" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 545.944941] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b68df9f-6bb6-4d2a-ab38-c8f2a96aff65',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 546.448294] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4b68df9f-6bb6-4d2a-ab38-c8f2a96aff65 [ 546.448294] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 546.448294] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 546.449612] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 546.449691] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 546.449819] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 546.449989] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4b68df9f-6bb6-4d2a-ab38-c8f2a96aff65 already deleted. [ 546.450259] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b68df9f-6bb6-4d2a-ab38-c8f2a96aff65" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 547.249742] env[62842]: INFO networking_nsxv3.common.synchronization [None req-bee29ae5-a4a9-4d06-8eaf-29280dc12891 None None] Enqueued Resource ID: 3c2e8910-810a-43ce-96e2-b56da0e2465c with Priority: HIGHEST for action port [ 547.249742] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c2e8910-810a-43ce-96e2-b56da0e2465c with Priority: HIGHEST for action port [ 547.250300] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c2e8910-810a-43ce-96e2-b56da0e2465c taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.250460] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c2e8910-810a-43ce-96e2-b56da0e2465c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.250529] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c2e8910-810a-43ce-96e2-b56da0e2465c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 547.251470] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c2e8910-810a-43ce-96e2-b56da0e2465c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 547.251665] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c2e8910-810a-43ce-96e2-b56da0e2465c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 547.651539] env[62842]: INFO networking_nsxv3.common.synchronization [None req-4846dcef-c337-45bb-a086-00ffdcd92604 None None] Enqueued Resource ID: d313fe32-c076-453e-92b3-5d8a117c6e05 with Priority: HIGHEST for action port [ 547.651539] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d313fe32-c076-453e-92b3-5d8a117c6e05 with Priority: HIGHEST for action port [ 547.651539] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-d313fe32-c076-453e-92b3-5d8a117c6e05 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.651539] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d313fe32-c076-453e-92b3-5d8a117c6e05" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.651539] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d313fe32-c076-453e-92b3-5d8a117c6e05" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 547.651539] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d313fe32-c076-453e-92b3-5d8a117c6e05" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 547.651539] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d313fe32-c076-453e-92b3-5d8a117c6e05',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 547.755712] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3c2e8910-810a-43ce-96e2-b56da0e2465c [ 547.756909] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.756909] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.756909] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 547.756909] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 547.756909] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 547.756909] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3c2e8910-810a-43ce-96e2-b56da0e2465c already deleted. [ 547.756909] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c2e8910-810a-43ce-96e2-b56da0e2465c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 548.153928] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d313fe32-c076-453e-92b3-5d8a117c6e05 [ 548.154185] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 548.154316] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 548.154381] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 548.154585] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 548.154674] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 548.154808] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d313fe32-c076-453e-92b3-5d8a117c6e05 already deleted. [ 548.154848] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d313fe32-c076-453e-92b3-5d8a117c6e05" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 548.823763] env[62842]: INFO networking_nsxv3.common.synchronization [None req-8958e46d-cd37-4f08-87b0-31dd7a056f6f None None] Enqueued Resource ID: cbf308f5-ff6b-4ed4-ba6d-4804b2dfb292 with Priority: HIGHEST for action port [ 548.824200] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbf308f5-ff6b-4ed4-ba6d-4804b2dfb292 with Priority: HIGHEST for action port [ 548.824691] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-cbf308f5-ff6b-4ed4-ba6d-4804b2dfb292 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 548.824853] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cbf308f5-ff6b-4ed4-ba6d-4804b2dfb292" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 548.824894] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cbf308f5-ff6b-4ed4-ba6d-4804b2dfb292" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 548.826665] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cbf308f5-ff6b-4ed4-ba6d-4804b2dfb292" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 548.826665] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cbf308f5-ff6b-4ed4-ba6d-4804b2dfb292',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 548.836446] env[62842]: INFO networking_nsxv3.common.synchronization [None req-292c1cda-3a81-4515-8cf8-6885687ed731 None None] Enqueued Resource ID: e97b657b-5ceb-4152-8adf-00b982608829 with Priority: HIGHEST for action port [ 548.836673] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e97b657b-5ceb-4152-8adf-00b982608829 with Priority: HIGHEST for action port [ 548.837237] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-e97b657b-5ceb-4152-8adf-00b982608829 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 548.837352] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e97b657b-5ceb-4152-8adf-00b982608829" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 548.837414] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e97b657b-5ceb-4152-8adf-00b982608829" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 548.837655] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e97b657b-5ceb-4152-8adf-00b982608829" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 548.837733] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e97b657b-5ceb-4152-8adf-00b982608829',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 549.328716] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cbf308f5-ff6b-4ed4-ba6d-4804b2dfb292 [ 549.329529] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.329770] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.330251] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 549.331313] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 549.331313] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 549.331313] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cbf308f5-ff6b-4ed4-ba6d-4804b2dfb292 already deleted. [ 549.331313] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cbf308f5-ff6b-4ed4-ba6d-4804b2dfb292" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 549.345768] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e97b657b-5ceb-4152-8adf-00b982608829 [ 549.345768] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.345768] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.345768] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 549.345768] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 549.345768] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 549.345768] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e97b657b-5ceb-4152-8adf-00b982608829 already deleted. [ 549.345768] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e97b657b-5ceb-4152-8adf-00b982608829" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 549.504856] env[62842]: INFO networking_nsxv3.common.synchronization [None req-4d3b50c2-774d-4015-a465-648d4ce5946d None None] Enqueued Resource ID: 87b27cae-185c-4465-a384-6efa69061618 with Priority: HIGHEST for action port [ 549.504856] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87b27cae-185c-4465-a384-6efa69061618 with Priority: HIGHEST for action port [ 549.504856] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-87b27cae-185c-4465-a384-6efa69061618 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.508053] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-87b27cae-185c-4465-a384-6efa69061618" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.509046] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-87b27cae-185c-4465-a384-6efa69061618" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 549.509746] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-87b27cae-185c-4465-a384-6efa69061618" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 549.510039] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('87b27cae-185c-4465-a384-6efa69061618',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 549.720590] env[62842]: INFO networking_nsxv3.common.synchronization [None req-d77ba25b-eb02-46f2-9b8e-e9175aaff9d5 None None] Enqueued Resource ID: fb6dca3f-7eed-4e34-bfc9-9726e7e65f00 with Priority: HIGHEST for action port [ 549.722204] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb6dca3f-7eed-4e34-bfc9-9726e7e65f00 with Priority: HIGHEST for action port [ 549.722204] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb6dca3f-7eed-4e34-bfc9-9726e7e65f00 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.722204] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb6dca3f-7eed-4e34-bfc9-9726e7e65f00" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.722204] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb6dca3f-7eed-4e34-bfc9-9726e7e65f00" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 549.722423] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb6dca3f-7eed-4e34-bfc9-9726e7e65f00" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 549.722423] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb6dca3f-7eed-4e34-bfc9-9726e7e65f00',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 549.925919] env[62842]: INFO networking_nsxv3.common.synchronization [None req-985708ec-7c16-46d6-b0a0-f1ce2e6fb688 None None] Enqueued Resource ID: c3d61003-82ff-468e-b80c-c7fcadae66ec with Priority: HIGHEST for action port [ 549.925919] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3d61003-82ff-468e-b80c-c7fcadae66ec with Priority: HIGHEST for action port [ 549.926705] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3d61003-82ff-468e-b80c-c7fcadae66ec taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.926705] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3d61003-82ff-468e-b80c-c7fcadae66ec" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.926705] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3d61003-82ff-468e-b80c-c7fcadae66ec" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 549.927242] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3d61003-82ff-468e-b80c-c7fcadae66ec" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 549.927242] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3d61003-82ff-468e-b80c-c7fcadae66ec',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 550.012972] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 87b27cae-185c-4465-a384-6efa69061618 [ 550.012972] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.012972] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.012972] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 550.013163] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 550.013250] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 550.013363] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:87b27cae-185c-4465-a384-6efa69061618 already deleted. [ 550.013470] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-87b27cae-185c-4465-a384-6efa69061618" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 550.075431] env[62842]: INFO networking_nsxv3.common.synchronization [None req-da060ad3-8dca-4c22-a98e-247550c04e66 None None] Enqueued Resource ID: bf6f0fac-1a5a-482f-bbc6-878a6c0401f1 with Priority: HIGHEST for action port [ 550.075637] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf6f0fac-1a5a-482f-bbc6-878a6c0401f1 with Priority: HIGHEST for action port [ 550.075893] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf6f0fac-1a5a-482f-bbc6-878a6c0401f1 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.076021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf6f0fac-1a5a-482f-bbc6-878a6c0401f1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.076219] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf6f0fac-1a5a-482f-bbc6-878a6c0401f1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 550.076362] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf6f0fac-1a5a-482f-bbc6-878a6c0401f1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 550.079041] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf6f0fac-1a5a-482f-bbc6-878a6c0401f1',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 550.227409] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fb6dca3f-7eed-4e34-bfc9-9726e7e65f00 [ 550.228805] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.228805] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.228805] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 550.228805] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 550.228805] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 550.228805] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fb6dca3f-7eed-4e34-bfc9-9726e7e65f00 already deleted. [ 550.228805] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb6dca3f-7eed-4e34-bfc9-9726e7e65f00" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 550.431021] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c3d61003-82ff-468e-b80c-c7fcadae66ec [ 550.432523] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.432523] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.432523] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 550.432523] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 550.432523] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 550.432523] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c3d61003-82ff-468e-b80c-c7fcadae66ec already deleted. [ 550.432523] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3d61003-82ff-468e-b80c-c7fcadae66ec" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 550.584216] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bf6f0fac-1a5a-482f-bbc6-878a6c0401f1 [ 550.584216] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.584216] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.584216] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 550.584216] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 550.584216] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 550.584216] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bf6f0fac-1a5a-482f-bbc6-878a6c0401f1 already deleted. [ 550.584216] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf6f0fac-1a5a-482f-bbc6-878a6c0401f1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 550.951250] env[62842]: INFO networking_nsxv3.common.synchronization [None req-3626848c-f662-4f9b-aee5-3d8628776f08 None None] Enqueued Resource ID: cd9a1432-ca00-4b74-9488-8cc4d8ab06ec with Priority: HIGHEST for action port [ 550.951512] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd9a1432-ca00-4b74-9488-8cc4d8ab06ec with Priority: HIGHEST for action port [ 550.952223] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-cd9a1432-ca00-4b74-9488-8cc4d8ab06ec taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.952341] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cd9a1432-ca00-4b74-9488-8cc4d8ab06ec" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.952407] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cd9a1432-ca00-4b74-9488-8cc4d8ab06ec" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 550.952649] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cd9a1432-ca00-4b74-9488-8cc4d8ab06ec" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 550.952724] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd9a1432-ca00-4b74-9488-8cc4d8ab06ec',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 551.456046] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cd9a1432-ca00-4b74-9488-8cc4d8ab06ec [ 551.456254] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 551.456388] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 551.456456] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 551.456699] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 551.456854] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 551.456902] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cd9a1432-ca00-4b74-9488-8cc4d8ab06ec already deleted. [ 551.457337] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cd9a1432-ca00-4b74-9488-8cc4d8ab06ec" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 551.595797] env[62842]: INFO networking_nsxv3.common.synchronization [None req-93dc7620-2337-4359-956d-d22e172f0949 tempest-ServersTestFqdnHostnames-908808954 tempest-ServersTestFqdnHostnames-908808954-project-member] Enqueued Resource ID: cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37 with Priority: HIGHEST for action security_group_rules [ 551.596643] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37 with Priority: HIGHEST for action security_group_rules [ 551.596738] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 551.596866] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 551.596931] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 551.597295] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 551.597382] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 551.740614] env[62842]: INFO networking_nsxv3.common.synchronization [None req-a3e37d70-88c0-4f97-9ac1-4f1db6dcb2bb tempest-ServersTestFqdnHostnames-908808954 tempest-ServersTestFqdnHostnames-908808954-project-member] Enqueued Resource ID: cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37 with Priority: HIGHEST for action security_group_rules [ 551.741171] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37 with Priority: HIGHEST for action security_group_rules [ 551.741470] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 551.741578] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 551.780238] env[62842]: INFO networking_nsxv3.common.synchronization [None req-4842d61c-2679-45eb-bd19-4440ea354705 None None] Enqueued Resource ID: 20df60e3-1adf-403a-884b-f6f8664fbc61 with Priority: HIGHEST for action port [ 551.781030] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20df60e3-1adf-403a-884b-f6f8664fbc61 with Priority: HIGHEST for action port [ 551.781302] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-20df60e3-1adf-403a-884b-f6f8664fbc61 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 551.782228] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-20df60e3-1adf-403a-884b-f6f8664fbc61" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 551.782228] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-20df60e3-1adf-403a-884b-f6f8664fbc61" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 551.782228] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-20df60e3-1adf-403a-884b-f6f8664fbc61" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 551.782228] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20df60e3-1adf-403a-884b-f6f8664fbc61',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 552.122788] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 552.123115] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 552.123115] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 552.124240] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 552.124240] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 552.124240] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37 already deleted. [ 552.124240] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 552.124240] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 552.124240] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 552.124240] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 552.286877] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 20df60e3-1adf-403a-884b-f6f8664fbc61 [ 552.286877] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 552.286877] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 552.286877] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 552.286877] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 552.286877] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 552.286877] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:20df60e3-1adf-403a-884b-f6f8664fbc61 already deleted. [ 552.286877] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-20df60e3-1adf-403a-884b-f6f8664fbc61" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 552.645462] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 552.645624] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 552.645713] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 552.646183] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 552.646183] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 552.646183] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37 already deleted. [ 552.646183] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 552.969565] env[62842]: INFO networking_nsxv3.common.synchronization [None req-b14b9aeb-a805-4aa1-ad7c-cedb99a8279e None None] Enqueued Resource ID: e7d54699-eaf6-44b1-88e7-d8a5b3b007b1 with Priority: HIGHEST for action port [ 552.969849] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7d54699-eaf6-44b1-88e7-d8a5b3b007b1 with Priority: HIGHEST for action port [ 552.970658] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-e7d54699-eaf6-44b1-88e7-d8a5b3b007b1 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 552.970658] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e7d54699-eaf6-44b1-88e7-d8a5b3b007b1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 552.970808] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e7d54699-eaf6-44b1-88e7-d8a5b3b007b1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 552.970978] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e7d54699-eaf6-44b1-88e7-d8a5b3b007b1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 552.976065] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7d54699-eaf6-44b1-88e7-d8a5b3b007b1',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 553.096847] env[62842]: INFO networking_nsxv3.common.synchronization [None req-ecc171f3-3b9d-47ac-8d70-7cd83c746209 tempest-AttachVolumeShelveTestJSON-759972748 tempest-AttachVolumeShelveTestJSON-759972748-project-member] Enqueued Resource ID: e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55 with Priority: HIGHEST for action security_group_rules [ 553.099089] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55 with Priority: HIGHEST for action security_group_rules [ 553.099755] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 553.099755] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 553.099755] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 553.100374] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 553.100374] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 553.478745] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e7d54699-eaf6-44b1-88e7-d8a5b3b007b1 [ 553.478996] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 553.479175] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 553.479175] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 553.480794] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 553.480794] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 553.480794] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e7d54699-eaf6-44b1-88e7-d8a5b3b007b1 already deleted. [ 553.480794] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e7d54699-eaf6-44b1-88e7-d8a5b3b007b1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 553.624214] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 553.624408] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 553.624458] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 553.624647] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 553.624739] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 553.624841] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55 already deleted. [ 553.624920] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 553.693908] env[62842]: INFO networking_nsxv3.common.synchronization [None req-70377201-3aa1-420c-be70-4b55c922c8de tempest-AttachVolumeShelveTestJSON-759972748 tempest-AttachVolumeShelveTestJSON-759972748-project-member] Enqueued Resource ID: e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55 with Priority: HIGHEST for action security_group_rules [ 553.693908] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55 with Priority: HIGHEST for action security_group_rules [ 553.693908] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 553.693908] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 553.693908] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 553.700183] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 553.700320] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 554.178963] env[62842]: INFO networking_nsxv3.common.synchronization [None req-c76d9474-2e2d-460b-b68f-4a08ba1fa877 None None] Enqueued Resource ID: 39ed55fb-1d01-4bec-a8fb-8324e54fada0 with Priority: HIGHEST for action port [ 554.179271] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39ed55fb-1d01-4bec-a8fb-8324e54fada0 with Priority: HIGHEST for action port [ 554.179753] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-39ed55fb-1d01-4bec-a8fb-8324e54fada0 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 554.179870] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39ed55fb-1d01-4bec-a8fb-8324e54fada0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 554.179926] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39ed55fb-1d01-4bec-a8fb-8324e54fada0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 554.180205] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39ed55fb-1d01-4bec-a8fb-8324e54fada0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 554.180284] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39ed55fb-1d01-4bec-a8fb-8324e54fada0',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 554.221239] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 554.221420] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 554.221469] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 554.221659] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 554.221861] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 554.221861] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55 already deleted. [ 554.221926] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 554.530381] env[62842]: INFO networking_nsxv3.common.synchronization [None req-6ca883f9-3d32-4dde-a1c5-683859a04f20 None None] Enqueued Resource ID: cfca2641-e38c-425f-8582-04be0975fd00 with Priority: HIGHEST for action port [ 554.531091] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfca2641-e38c-425f-8582-04be0975fd00 with Priority: HIGHEST for action port [ 554.531822] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-cfca2641-e38c-425f-8582-04be0975fd00 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 554.531822] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cfca2641-e38c-425f-8582-04be0975fd00" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 554.531822] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cfca2641-e38c-425f-8582-04be0975fd00" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 554.532165] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cfca2641-e38c-425f-8582-04be0975fd00" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 554.533057] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cfca2641-e38c-425f-8582-04be0975fd00',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 554.684222] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 39ed55fb-1d01-4bec-a8fb-8324e54fada0 [ 554.684222] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 554.684222] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 554.684222] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 554.684222] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 554.684222] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 554.684222] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:39ed55fb-1d01-4bec-a8fb-8324e54fada0 already deleted. [ 554.684222] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39ed55fb-1d01-4bec-a8fb-8324e54fada0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 555.034839] env[62842]: INFO networking_nsxv3.common.synchronization [None req-c90ed0f6-fee7-4c4d-84b1-ac2beca0cbae None None] Enqueued Resource ID: 98361f96-57d9-40c7-b261-402091a047b1 with Priority: HIGHEST for action port [ 555.036105] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98361f96-57d9-40c7-b261-402091a047b1 with Priority: HIGHEST for action port [ 555.036456] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cfca2641-e38c-425f-8582-04be0975fd00 [ 555.036746] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 555.036916] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 555.037029] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 555.037317] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 555.037524] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 555.037681] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cfca2641-e38c-425f-8582-04be0975fd00 already deleted. [ 555.037941] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cfca2641-e38c-425f-8582-04be0975fd00" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 555.038453] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-98361f96-57d9-40c7-b261-402091a047b1 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 555.040163] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-98361f96-57d9-40c7-b261-402091a047b1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 555.040241] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-98361f96-57d9-40c7-b261-402091a047b1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 555.040502] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-98361f96-57d9-40c7-b261-402091a047b1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 555.040588] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98361f96-57d9-40c7-b261-402091a047b1',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 555.543482] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 98361f96-57d9-40c7-b261-402091a047b1 [ 555.543782] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 555.543848] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 555.543901] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 555.544107] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 555.544265] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 555.544312] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:98361f96-57d9-40c7-b261-402091a047b1 already deleted. [ 555.544376] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-98361f96-57d9-40c7-b261-402091a047b1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 556.704021] env[62842]: INFO networking_nsxv3.common.synchronization [None req-206dcc74-1c0f-4718-832b-12e0bbda630c None None] Enqueued Resource ID: b8fe7f9d-047d-407d-829f-fe990723f375 with Priority: HIGHEST for action port [ 556.704021] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8fe7f9d-047d-407d-829f-fe990723f375 with Priority: HIGHEST for action port [ 556.704021] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-b8fe7f9d-047d-407d-829f-fe990723f375 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 556.704021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b8fe7f9d-047d-407d-829f-fe990723f375" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 556.704021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b8fe7f9d-047d-407d-829f-fe990723f375" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 556.705177] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b8fe7f9d-047d-407d-829f-fe990723f375" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 556.705340] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8fe7f9d-047d-407d-829f-fe990723f375',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 557.210524] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b8fe7f9d-047d-407d-829f-fe990723f375 [ 557.211055] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 557.211208] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 557.211279] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 557.211506] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 557.211595] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 557.211691] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b8fe7f9d-047d-407d-829f-fe990723f375 already deleted. [ 557.211770] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b8fe7f9d-047d-407d-829f-fe990723f375" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 557.236657] env[62842]: INFO networking_nsxv3.common.synchronization [req-6491922a-da8a-4230-948e-984eb851cd02 req-81bf788c-3831-4c44-95f2-5b54affd3a88 tempest-DeleteServersAdminTestJSON-2057441283 tempest-DeleteServersAdminTestJSON-2057441283-project-member] Enqueued Resource ID: d014d213-d805-403a-bcc9-8c66da8eefa2 with Priority: HIGHEST for action security_group_members [ 557.236828] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d014d213-d805-403a-bcc9-8c66da8eefa2 with Priority: HIGHEST for action security_group_members [ 557.237591] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-d014d213-d805-403a-bcc9-8c66da8eefa2 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 557.237721] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 557.237798] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 557.238132] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 557.238342] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 557.238453] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 557.238539] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 557.238677] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 557.238765] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 557.238858] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d014d213-d805-403a-bcc9-8c66da8eefa2',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 557.734710] env[62842]: INFO networking_nsxv3.common.synchronization [None req-cc0f3287-5bce-4c3f-a04f-1c40600306d7 None None] Enqueued Resource ID: dbbffe00-2e7f-4326-9801-5764b451d90d with Priority: HIGHEST for action port [ 557.735525] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbbffe00-2e7f-4326-9801-5764b451d90d with Priority: HIGHEST for action port [ 557.736550] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-dbbffe00-2e7f-4326-9801-5764b451d90d taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 557.737126] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dbbffe00-2e7f-4326-9801-5764b451d90d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 557.737126] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dbbffe00-2e7f-4326-9801-5764b451d90d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 557.737126] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dbbffe00-2e7f-4326-9801-5764b451d90d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 557.737126] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbbffe00-2e7f-4326-9801-5764b451d90d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 557.741880] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 557.741880] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 557.741880] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 557.741880] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 557.741880] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 557.742120] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 557.744024] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 557.744024] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 557.744024] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 557.744024] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 557.744024] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d014d213-d805-403a-bcc9-8c66da8eefa2 already deleted. [ 557.744024] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 558.240230] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dbbffe00-2e7f-4326-9801-5764b451d90d [ 558.242323] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 558.242484] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 558.242554] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 558.242758] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 558.242844] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 558.242942] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dbbffe00-2e7f-4326-9801-5764b451d90d already deleted. [ 558.243037] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dbbffe00-2e7f-4326-9801-5764b451d90d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 558.539073] env[62842]: INFO networking_nsxv3.common.synchronization [None req-758c2843-fb8f-4767-9cc6-a31ed1c9f3a3 None None] Enqueued Resource ID: f7f3210b-4def-42b3-89af-f86c40188563 with Priority: HIGHEST for action port [ 558.539922] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7f3210b-4def-42b3-89af-f86c40188563 with Priority: HIGHEST for action port [ 558.540283] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-f7f3210b-4def-42b3-89af-f86c40188563 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 558.541092] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f7f3210b-4def-42b3-89af-f86c40188563" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 558.541092] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f7f3210b-4def-42b3-89af-f86c40188563" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 558.541092] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f7f3210b-4def-42b3-89af-f86c40188563" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 558.541092] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7f3210b-4def-42b3-89af-f86c40188563',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 558.909583] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-938 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 558.909583] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-938" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 558.909583] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-938" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 558.910211] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-938" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 558.910211] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 558.910421] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 558.910498] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 558.910725] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 558.910871] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 558.913121] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 558.913121] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 558.913121] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 558.913121] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 558.913121] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 558.913121] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 558.913121] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 558.938217] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 558.938217] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 558.938217] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 558.938217] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-938" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 558.938217] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-e57837ca-399d-4607-88f8-4604b7508f93 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 558.938217] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-e57837ca-399d-4607-88f8-4604b7508f93" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 558.938217] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-e57837ca-399d-4607-88f8-4604b7508f93" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 558.938695] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-e57837ca-399d-4607-88f8-4604b7508f93" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 558.939025] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e57837ca-399d-4607-88f8-4604b7508f93',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 559.043853] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f7f3210b-4def-42b3-89af-f86c40188563 [ 559.043853] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 559.043853] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 559.043853] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 559.044074] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 559.044207] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 559.044299] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f7f3210b-4def-42b3-89af-f86c40188563 already deleted. [ 559.044363] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f7f3210b-4def-42b3-89af-f86c40188563" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 559.442723] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 559.442943] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 559.443099] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 559.443388] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 559.443542] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 559.443712] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port e57837ca-399d-4607-88f8-4604b7508f93 not found, creating... [ 559.444141] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 559.444141] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 559.444284] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 559.444441] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 559.444578] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 559.444938] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 559.445815] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 559.445815] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 559.446146] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 559.446539] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 559.446539] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: e57837ca-399d-4607-88f8-4604b7508f93 is going to be created. [ 559.468190] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 559.468531] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 559.468531] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 559.468795] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 559.469062] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 559.469288] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-e57837ca-399d-4607-88f8-4604b7508f93" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 560.672351] env[62842]: INFO networking_nsxv3.common.synchronization [req-6491922a-da8a-4230-948e-984eb851cd02 req-fefe7da1-60b7-46a6-83cc-72497fe246ec service nova] Enqueued Resource ID: d014d213-d805-403a-bcc9-8c66da8eefa2 with Priority: HIGHEST for action security_group_rules [ 560.672351] env[62842]: INFO networking_nsxv3.common.synchronization [req-6491922a-da8a-4230-948e-984eb851cd02 req-fefe7da1-60b7-46a6-83cc-72497fe246ec service nova] Enqueued Resource ID: d014d213-d805-403a-bcc9-8c66da8eefa2 with Priority: HIGHEST for action security_group_members [ 560.672351] env[62842]: INFO networking_nsxv3.common.synchronization [req-6491922a-da8a-4230-948e-984eb851cd02 req-fefe7da1-60b7-46a6-83cc-72497fe246ec service nova] Enqueued Resource ID: e57837ca-399d-4607-88f8-4604b7508f93 with Priority: HIGHEST for action port [ 560.672351] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d014d213-d805-403a-bcc9-8c66da8eefa2 with Priority: HIGHEST for action security_group_rules [ 560.672351] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d014d213-d805-403a-bcc9-8c66da8eefa2 with Priority: HIGHEST for action security_group_members [ 560.672351] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e57837ca-399d-4607-88f8-4604b7508f93 with Priority: HIGHEST for action port [ 560.677591] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d014d213-d805-403a-bcc9-8c66da8eefa2 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 560.677591] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 560.677591] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 560.677591] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 560.677591] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d014d213-d805-403a-bcc9-8c66da8eefa2',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 560.677591] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-d014d213-d805-403a-bcc9-8c66da8eefa2 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 560.677591] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 560.677591] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 560.677591] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 560.677591] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 560.677591] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 560.677591] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 560.677591] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 560.677591] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 560.677591] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d014d213-d805-403a-bcc9-8c66da8eefa2',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 560.677591] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-e57837ca-399d-4607-88f8-4604b7508f93 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 560.678323] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e57837ca-399d-4607-88f8-4604b7508f93" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 560.678323] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e57837ca-399d-4607-88f8-4604b7508f93" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 560.678323] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e57837ca-399d-4607-88f8-4604b7508f93" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 560.678323] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e57837ca-399d-4607-88f8-4604b7508f93',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 560.807624] env[62842]: INFO networking_nsxv3.common.synchronization [req-d3a3e31c-d332-4ab4-9cca-cfc14c51eeb1 req-66a5f638-3e64-4119-ab04-c542ed59d9c6 tempest-ServerExternalEventsTest-541493461 tempest-ServerExternalEventsTest-541493461-project-member] Enqueued Resource ID: b132ea78-a4b4-47a2-98dc-0d195c085bca with Priority: HIGHEST for action security_group_members [ 560.807624] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b132ea78-a4b4-47a2-98dc-0d195c085bca with Priority: HIGHEST for action security_group_members [ 560.807624] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-b132ea78-a4b4-47a2-98dc-0d195c085bca taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 560.808432] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b132ea78-a4b4-47a2-98dc-0d195c085bca" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 560.808432] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b132ea78-a4b4-47a2-98dc-0d195c085bca" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 560.808604] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b132ea78-a4b4-47a2-98dc-0d195c085bca" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 560.809056] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 560.809283] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 560.809558] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 560.809931] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 560.811487] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 560.811487] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b132ea78-a4b4-47a2-98dc-0d195c085bca',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 561.183723] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-d014d213-d805-403a-bcc9-8c66da8eefa2 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 561.183723] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 561.190249] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d014d213-d805-403a-bcc9-8c66da8eefa2',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 561.191261] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e57837ca-399d-4607-88f8-4604b7508f93 with status ACTIVE [ 561.191471] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 561.191615] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 561.191683] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 561.191885] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 561.191971] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 561.192196] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 561.192299] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 561.192397] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 561.192540] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 561.192571] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 561.192757] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 561.192851] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 561.192902] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 561.193062] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 561.193126] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 561.193209] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e57837ca-399d-4607-88f8-4604b7508f93 is going to be updated. [ 561.229069] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 561.229269] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 561.229344] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 561.230086] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 561.230086] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 561.230086] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e57837ca-399d-4607-88f8-4604b7508f93" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 561.313612] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 561.313835] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 561.313963] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 561.314750] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 561.315168] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 561.315464] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 561.316031] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 561.316122] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 561.316379] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 561.316475] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 561.316572] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b132ea78-a4b4-47a2-98dc-0d195c085bca already deleted. [ 561.317787] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b132ea78-a4b4-47a2-98dc-0d195c085bca" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 561.360623] env[62842]: INFO networking_nsxv3.common.synchronization [None req-74d4338b-f5f1-4526-a754-4eba24e08e7a None None] Enqueued Resource ID: 2d122580-05b8-4b6d-892f-78dd80b31c20 with Priority: HIGHEST for action port [ 561.361253] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d122580-05b8-4b6d-892f-78dd80b31c20 with Priority: HIGHEST for action port [ 561.361568] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d122580-05b8-4b6d-892f-78dd80b31c20 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 561.361694] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d122580-05b8-4b6d-892f-78dd80b31c20" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 561.361757] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d122580-05b8-4b6d-892f-78dd80b31c20" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 561.366146] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d122580-05b8-4b6d-892f-78dd80b31c20" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 561.366489] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d122580-05b8-4b6d-892f-78dd80b31c20',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 561.527674] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-938 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 561.527822] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-938" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 561.527905] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-938" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 561.530375] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-938" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 561.530804] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 561.531368] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 561.531368] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 561.532328] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 561.532538] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 561.532831] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 561.532956] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 561.533077] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 561.533212] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 561.533333] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 561.533443] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 561.533581] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 561.555930] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 561.556210] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 561.556443] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 561.558076] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-938" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 561.558426] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-eb5bc644-5a90-40ff-8882-4c2089f7ddf9 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 561.558621] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-eb5bc644-5a90-40ff-8882-4c2089f7ddf9" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 561.558789] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-eb5bc644-5a90-40ff-8882-4c2089f7ddf9" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 561.560699] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-eb5bc644-5a90-40ff-8882-4c2089f7ddf9" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 561.560699] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb5bc644-5a90-40ff-8882-4c2089f7ddf9',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 561.666813] env[62842]: INFO networking_nsxv3.common.synchronization [None req-893c332a-381e-44eb-a485-eec906e608d1 None None] Enqueued Resource ID: 941ce2d5-fc06-405b-ac94-6734f0db5812 with Priority: HIGHEST for action port [ 561.667765] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 941ce2d5-fc06-405b-ac94-6734f0db5812 with Priority: HIGHEST for action port [ 561.667930] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-941ce2d5-fc06-405b-ac94-6734f0db5812 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 561.668425] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-941ce2d5-fc06-405b-ac94-6734f0db5812" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 561.668536] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-941ce2d5-fc06-405b-ac94-6734f0db5812" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 561.668816] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-941ce2d5-fc06-405b-ac94-6734f0db5812" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 561.668926] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('941ce2d5-fc06-405b-ac94-6734f0db5812',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 561.695543] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d014d213-d805-403a-bcc9-8c66da8eefa2',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 561.871718] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2d122580-05b8-4b6d-892f-78dd80b31c20 [ 561.871956] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 561.872280] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 561.872280] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 561.872407] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 561.872504] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 561.872604] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2d122580-05b8-4b6d-892f-78dd80b31c20 already deleted. [ 561.873061] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d122580-05b8-4b6d-892f-78dd80b31c20" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 561.932284] env[62842]: INFO networking_nsxv3.common.synchronization [None req-c6203e69-ad15-488b-9b69-3a5fc43fbabc None None] Enqueued Resource ID: df83cd52-7a9a-4499-b2fc-783dc182dcd0 with Priority: HIGHEST for action port [ 561.932767] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df83cd52-7a9a-4499-b2fc-783dc182dcd0 with Priority: HIGHEST for action port [ 561.932955] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-df83cd52-7a9a-4499-b2fc-783dc182dcd0 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 561.933184] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df83cd52-7a9a-4499-b2fc-783dc182dcd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 561.933184] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df83cd52-7a9a-4499-b2fc-783dc182dcd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 561.933907] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df83cd52-7a9a-4499-b2fc-783dc182dcd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 561.933907] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df83cd52-7a9a-4499-b2fc-783dc182dcd0',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 562.066727] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 562.066727] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 562.066727] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 562.066727] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 562.066727] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 562.066727] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port eb5bc644-5a90-40ff-8882-4c2089f7ddf9 not found, creating... [ 562.070362] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 562.071253] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 562.071253] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 562.071253] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 562.071253] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 562.071552] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 562.071717] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 562.071832] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 562.075870] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 562.075870] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 562.075870] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: eb5bc644-5a90-40ff-8882-4c2089f7ddf9 is going to be created. [ 562.094571] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 562.097238] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 562.097518] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 562.097810] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 562.099682] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 562.099950] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-eb5bc644-5a90-40ff-8882-4c2089f7ddf9" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 562.170975] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 941ce2d5-fc06-405b-ac94-6734f0db5812 [ 562.171250] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 562.171414] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 562.171485] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 562.172325] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 562.172325] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 562.172325] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:941ce2d5-fc06-405b-ac94-6734f0db5812 already deleted. [ 562.172325] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-941ce2d5-fc06-405b-ac94-6734f0db5812" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 562.199619] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 562.199619] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 562.199619] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 562.199619] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 562.199619] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 562.199619] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d014d213-d805-403a-bcc9-8c66da8eefa2 is going to be created. [ 562.243692] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 562.243692] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 562.243692] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 562.243692] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 562.243692] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 562.256560] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d014d213-d805-403a-bcc9-8c66da8eefa2 in Status: UNINITIALIZED for 2s [ 562.436679] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port df83cd52-7a9a-4499-b2fc-783dc182dcd0 [ 562.438416] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 562.438416] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 562.438416] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 562.438416] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 562.438416] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 562.438416] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:df83cd52-7a9a-4499-b2fc-783dc182dcd0 already deleted. [ 562.438416] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df83cd52-7a9a-4499-b2fc-783dc182dcd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 562.542201] env[62842]: INFO networking_nsxv3.common.synchronization [None req-8c2a59c9-2bb0-4142-ba6f-ef28aa938996 tempest-ServerActionsTestJSON-670456711 tempest-ServerActionsTestJSON-670456711-project-member] Enqueued Resource ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 with Priority: HIGHEST for action security_group_rules [ 562.542201] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 with Priority: HIGHEST for action security_group_rules [ 562.542201] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a03224f-b75b-48a5-9e23-3ca50aabbb33 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 562.544086] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 562.544263] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 562.544608] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 562.545220] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a03224f-b75b-48a5-9e23-3ca50aabbb33',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 562.752955] env[62842]: INFO networking_nsxv3.common.synchronization [None req-14b33ada-9a36-4f0a-b484-09fa338b349d None None] Enqueued Resource ID: 3ce2592b-f9e9-45f3-be47-d986c6c9667b with Priority: HIGHEST for action port [ 562.752955] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ce2592b-f9e9-45f3-be47-d986c6c9667b with Priority: HIGHEST for action port [ 562.752955] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ce2592b-f9e9-45f3-be47-d986c6c9667b taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 562.752955] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ce2592b-f9e9-45f3-be47-d986c6c9667b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 562.752955] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ce2592b-f9e9-45f3-be47-d986c6c9667b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 562.752955] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ce2592b-f9e9-45f3-be47-d986c6c9667b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 562.753572] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ce2592b-f9e9-45f3-be47-d986c6c9667b',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 562.947461] env[62842]: INFO networking_nsxv3.common.synchronization [None req-bc27f1d4-21b7-474c-b45f-376f03b08fec tempest-ServerActionsTestJSON-670456711 tempest-ServerActionsTestJSON-670456711-project-member] Enqueued Resource ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 with Priority: HIGHEST for action security_group_rules [ 562.948205] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 with Priority: HIGHEST for action security_group_rules [ 562.948570] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a03224f-b75b-48a5-9e23-3ca50aabbb33 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 562.948570] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 563.072422] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 563.072422] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 563.072422] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 563.072649] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 563.072746] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 563.072962] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 already deleted. [ 563.072962] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 563.073097] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 563.073258] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 563.073365] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a03224f-b75b-48a5-9e23-3ca50aabbb33',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 563.258175] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3ce2592b-f9e9-45f3-be47-d986c6c9667b [ 563.258175] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 563.258175] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 563.258175] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 563.258516] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 563.258516] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 563.258516] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3ce2592b-f9e9-45f3-be47-d986c6c9667b already deleted. [ 563.258611] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ce2592b-f9e9-45f3-be47-d986c6c9667b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 563.594882] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 563.595051] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 563.595125] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 563.595387] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 563.595453] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 563.595544] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 already deleted. [ 563.595635] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 563.636977] env[62842]: INFO networking_nsxv3.common.synchronization [req-92bf7ebc-5ca4-4960-ab6c-a28aa565b139 req-0559b065-3650-4ee1-81ae-ac5bbde07ebb tempest-ServerDiagnosticsTest-598226030 tempest-ServerDiagnosticsTest-598226030-project-member] Enqueued Resource ID: 473d98b1-ea12-43f6-8749-401a513b928c with Priority: HIGHEST for action security_group_members [ 563.636977] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 473d98b1-ea12-43f6-8749-401a513b928c with Priority: HIGHEST for action security_group_members [ 563.637999] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-473d98b1-ea12-43f6-8749-401a513b928c taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 563.637999] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-473d98b1-ea12-43f6-8749-401a513b928c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 563.637999] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-473d98b1-ea12-43f6-8749-401a513b928c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 563.639287] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-473d98b1-ea12-43f6-8749-401a513b928c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 563.639287] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 563.639287] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 563.639287] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 563.639287] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 563.639287] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 563.639287] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('473d98b1-ea12-43f6-8749-401a513b928c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 564.143824] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.144079] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.144079] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 564.148026] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 564.148026] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 564.148026] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.148026] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.148026] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 564.148026] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 564.148026] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 564.148026] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 473d98b1-ea12-43f6-8749-401a513b928c already deleted. [ 564.148026] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-473d98b1-ea12-43f6-8749-401a513b928c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 564.223454] env[62842]: INFO networking_nsxv3.common.synchronization [req-d3a3e31c-d332-4ab4-9cca-cfc14c51eeb1 req-17d37b1a-3718-40d3-ad65-187a11b4c043 service nova] Enqueued Resource ID: b132ea78-a4b4-47a2-98dc-0d195c085bca with Priority: HIGHEST for action security_group_rules [ 564.223622] env[62842]: INFO networking_nsxv3.common.synchronization [req-d3a3e31c-d332-4ab4-9cca-cfc14c51eeb1 req-17d37b1a-3718-40d3-ad65-187a11b4c043 service nova] Enqueued Resource ID: b132ea78-a4b4-47a2-98dc-0d195c085bca with Priority: HIGHEST for action security_group_members [ 564.223763] env[62842]: INFO networking_nsxv3.common.synchronization [req-d3a3e31c-d332-4ab4-9cca-cfc14c51eeb1 req-17d37b1a-3718-40d3-ad65-187a11b4c043 service nova] Enqueued Resource ID: eb5bc644-5a90-40ff-8882-4c2089f7ddf9 with Priority: HIGHEST for action port [ 564.224011] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b132ea78-a4b4-47a2-98dc-0d195c085bca with Priority: HIGHEST for action security_group_rules [ 564.224149] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b132ea78-a4b4-47a2-98dc-0d195c085bca with Priority: HIGHEST for action security_group_members [ 564.224246] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb5bc644-5a90-40ff-8882-4c2089f7ddf9 with Priority: HIGHEST for action port [ 564.224822] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b132ea78-a4b4-47a2-98dc-0d195c085bca taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.225789] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b132ea78-a4b4-47a2-98dc-0d195c085bca" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.225864] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b132ea78-a4b4-47a2-98dc-0d195c085bca" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 564.227729] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b132ea78-a4b4-47a2-98dc-0d195c085bca" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 564.227729] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b132ea78-a4b4-47a2-98dc-0d195c085bca',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 564.228894] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-b132ea78-a4b4-47a2-98dc-0d195c085bca taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.229017] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b132ea78-a4b4-47a2-98dc-0d195c085bca" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.229085] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b132ea78-a4b4-47a2-98dc-0d195c085bca" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 564.229269] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b132ea78-a4b4-47a2-98dc-0d195c085bca" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 564.229423] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.229517] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.229583] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 564.229720] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 564.229803] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 564.229891] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b132ea78-a4b4-47a2-98dc-0d195c085bca',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 564.234020] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-eb5bc644-5a90-40ff-8882-4c2089f7ddf9 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.234020] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eb5bc644-5a90-40ff-8882-4c2089f7ddf9" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.234020] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eb5bc644-5a90-40ff-8882-4c2089f7ddf9" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 564.234020] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eb5bc644-5a90-40ff-8882-4c2089f7ddf9" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 564.234020] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb5bc644-5a90-40ff-8882-4c2089f7ddf9',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 564.268686] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d014d213-d805-403a-bcc9-8c66da8eefa2 in Status: SUCCESS [ 564.268937] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 564.269558] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 564.269764] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 564.270970] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.270970] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.270970] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 564.270970] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 564.271340] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 564.271340] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 564.271340] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d014d213-d805-403a-bcc9-8c66da8eefa2',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 564.735251] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b132ea78-a4b4-47a2-98dc-0d195c085bca',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 564.735515] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-b132ea78-a4b4-47a2-98dc-0d195c085bca taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.735657] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b132ea78-a4b4-47a2-98dc-0d195c085bca" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.738207] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eb5bc644-5a90-40ff-8882-4c2089f7ddf9 with status ACTIVE [ 564.738538] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.738729] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.738802] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 564.739037] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 564.739130] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 564.739326] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.739545] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.739545] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 564.739679] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 564.739728] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 564.739918] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.740041] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.740109] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 564.740263] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 564.740340] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 564.740427] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eb5bc644-5a90-40ff-8882-4c2089f7ddf9 is going to be updated. [ 564.767339] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.767520] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.767598] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 564.767811] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 564.767954] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 564.768133] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eb5bc644-5a90-40ff-8882-4c2089f7ddf9" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 564.773577] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-d014d213-d805-403a-bcc9-8c66da8eefa2 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.777342] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.777342] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 564.777342] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 564.777342] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.777342] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.777342] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 564.777342] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 564.777342] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 564.777342] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 564.777342] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-d014d213-d805-403a-bcc9-8c66da8eefa2 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.777342] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.777342] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 564.777342] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 564.777342] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.777342] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.777342] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 564.777342] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 564.777342] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 564.778030] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 564.778030] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d014d213-d805-403a-bcc9-8c66da8eefa2',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 565.229940] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-938 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.229940] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-938" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.229940] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-938" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.229940] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-938" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.229940] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.232858] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.232858] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.232858] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.232858] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.232858] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 565.232858] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 565.232858] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 565.232858] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 565.232858] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 565.232858] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 565.232858] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 565.237832] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b132ea78-a4b4-47a2-98dc-0d195c085bca',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 565.254732] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 565.254732] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 565.254732] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 565.254732] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-938" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.254732] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-13be865a-3013-4611-b225-20bb12d5edaa taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.254732] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-13be865a-3013-4611-b225-20bb12d5edaa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.254732] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-13be865a-3013-4611-b225-20bb12d5edaa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.254732] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-13be865a-3013-4611-b225-20bb12d5edaa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.254732] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13be865a-3013-4611-b225-20bb12d5edaa',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 565.280930] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d014d213-d805-403a-bcc9-8c66da8eefa2: rpc.has_security_group_logging(os_id): False [ 565.299936] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.300909] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.300909] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.300909] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.300909] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.300909] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.300909] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.301708] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.301708] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.301708] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.301708] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.301708] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.301708] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.301708] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.302043] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.302043] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.302043] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.302202] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.302785] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.302785] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.302785] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d014d213-d805-403a-bcc9-8c66da8eefa2 is going to be created. [ 565.371567] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.371567] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.371567] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.371567] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.371567] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.382667] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d014d213-d805-403a-bcc9-8c66da8eefa2 in Status: IN_PROGRESS for 2s [ 565.740603] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.740756] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.741891] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.741891] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.741891] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.741891] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b132ea78-a4b4-47a2-98dc-0d195c085bca is going to be created. [ 565.763310] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.763310] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.763310] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.763310] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.763310] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.763310] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 13be865a-3013-4611-b225-20bb12d5edaa not found, creating... [ 565.763310] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.763310] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.763310] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.763310] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.763310] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.764028] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.764028] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.764028] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.764028] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.768432] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.768645] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 13be865a-3013-4611-b225-20bb12d5edaa is going to be created. [ 565.771806] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.771977] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.772065] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.772472] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.772721] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.793202] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b132ea78-a4b4-47a2-98dc-0d195c085bca in Status: UNINITIALIZED for 2s [ 565.804442] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.805247] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.805247] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.805435] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.805523] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.805752] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-13be865a-3013-4611-b225-20bb12d5edaa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.943399] env[62842]: INFO networking_nsxv3.common.synchronization [req-dbac47ac-90b1-4e97-b506-8b4282aa4c40 req-ac86f203-8176-4262-8fab-52207714bfb1 tempest-ImagesNegativeTestJSON-1147075728 tempest-ImagesNegativeTestJSON-1147075728-project-member] Enqueued Resource ID: 3f89b292-3278-4b67-9a1b-21e48a9ef380 with Priority: HIGHEST for action security_group_members [ 565.944311] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f89b292-3278-4b67-9a1b-21e48a9ef380 with Priority: HIGHEST for action security_group_members [ 565.944638] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f89b292-3278-4b67-9a1b-21e48a9ef380 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.944764] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f89b292-3278-4b67-9a1b-21e48a9ef380" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.944839] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f89b292-3278-4b67-9a1b-21e48a9ef380" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.945109] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f89b292-3278-4b67-9a1b-21e48a9ef380" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.945947] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.946064] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.946134] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.946304] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.946444] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.946545] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f89b292-3278-4b67-9a1b-21e48a9ef380',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 566.146087] env[62842]: INFO networking_nsxv3.common.synchronization [None req-056def67-4b89-4dc9-bf4c-66ba24dd93f9 None None] Enqueued Resource ID: 7b593fae-bc88-42cc-ac0b-cb210e8678db with Priority: HIGHEST for action port [ 566.146266] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b593fae-bc88-42cc-ac0b-cb210e8678db with Priority: HIGHEST for action port [ 566.146592] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-7b593fae-bc88-42cc-ac0b-cb210e8678db taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.146706] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7b593fae-bc88-42cc-ac0b-cb210e8678db" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.146773] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7b593fae-bc88-42cc-ac0b-cb210e8678db" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 566.148599] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7b593fae-bc88-42cc-ac0b-cb210e8678db" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 566.148782] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b593fae-bc88-42cc-ac0b-cb210e8678db',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 566.287404] env[62842]: INFO networking_nsxv3.common.synchronization [None req-c6d35ccd-e456-4701-8cff-4ae78ce3d1ff None None] Enqueued Resource ID: 28142949-5bfe-482b-a126-f83e1108e0b8 with Priority: HIGHEST for action port [ 566.287404] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28142949-5bfe-482b-a126-f83e1108e0b8 with Priority: HIGHEST for action port [ 566.287404] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-28142949-5bfe-482b-a126-f83e1108e0b8 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.289300] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-28142949-5bfe-482b-a126-f83e1108e0b8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.289836] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-28142949-5bfe-482b-a126-f83e1108e0b8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 566.290468] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-28142949-5bfe-482b-a126-f83e1108e0b8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 566.291161] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28142949-5bfe-482b-a126-f83e1108e0b8',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 566.449303] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.449589] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.450340] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 566.450340] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 566.450340] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 566.450340] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.450535] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.450535] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 566.451974] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 566.451974] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 566.451974] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f89b292-3278-4b67-9a1b-21e48a9ef380 already deleted. [ 566.451974] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f89b292-3278-4b67-9a1b-21e48a9ef380" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 566.651396] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7b593fae-bc88-42cc-ac0b-cb210e8678db [ 566.651632] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.651766] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.651841] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 566.652088] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 566.652185] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 566.652284] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7b593fae-bc88-42cc-ac0b-cb210e8678db already deleted. [ 566.652363] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7b593fae-bc88-42cc-ac0b-cb210e8678db" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 566.795187] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 28142949-5bfe-482b-a126-f83e1108e0b8 [ 566.795187] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.795187] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.795187] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 566.795187] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 566.795436] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 566.795436] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:28142949-5bfe-482b-a126-f83e1108e0b8 already deleted. [ 566.795436] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-28142949-5bfe-482b-a126-f83e1108e0b8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 566.944795] env[62842]: INFO networking_nsxv3.common.synchronization [None req-c79e6d90-b604-4580-aa18-48851c379920 None None] Enqueued Resource ID: 831360e5-03d9-4ad7-b67a-0440f4e77c25 with Priority: HIGHEST for action port [ 566.945727] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 831360e5-03d9-4ad7-b67a-0440f4e77c25 with Priority: HIGHEST for action port [ 566.945727] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-831360e5-03d9-4ad7-b67a-0440f4e77c25 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.945849] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-831360e5-03d9-4ad7-b67a-0440f4e77c25" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.945895] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-831360e5-03d9-4ad7-b67a-0440f4e77c25" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 566.946436] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-831360e5-03d9-4ad7-b67a-0440f4e77c25" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 566.946436] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('831360e5-03d9-4ad7-b67a-0440f4e77c25',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 567.399818] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d014d213-d805-403a-bcc9-8c66da8eefa2 in Status: SUCCESS [ 567.399818] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.453367] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 831360e5-03d9-4ad7-b67a-0440f4e77c25 [ 567.453622] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.453756] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.453821] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 567.454050] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 567.454134] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.454234] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:831360e5-03d9-4ad7-b67a-0440f4e77c25 already deleted. [ 567.454312] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-831360e5-03d9-4ad7-b67a-0440f4e77c25" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.806259] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b132ea78-a4b4-47a2-98dc-0d195c085bca in Status: SUCCESS [ 567.806488] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b132ea78-a4b4-47a2-98dc-0d195c085bca" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.806655] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b132ea78-a4b4-47a2-98dc-0d195c085bca" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 567.806882] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b132ea78-a4b4-47a2-98dc-0d195c085bca" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 567.807090] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.807205] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.807266] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 567.807451] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 567.807530] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.807615] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b132ea78-a4b4-47a2-98dc-0d195c085bca" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.807703] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b132ea78-a4b4-47a2-98dc-0d195c085bca',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 567.890637] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-476 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.890889] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-476" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.890962] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-476" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 567.891620] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-476" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 567.891620] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.891797] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.891847] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 567.893776] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 567.894173] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.894411] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 567.894717] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 567.894717] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 567.894717] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 567.894856] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 567.894943] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 567.895832] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 567.941140] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 567.941609] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.046 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 567.941671] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 567.941870] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-476" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.942335] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-8d647eeb-2ec5-49f1-b972-8e898b0b39d0 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.942589] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-8d647eeb-2ec5-49f1-b972-8e898b0b39d0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.942776] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-8d647eeb-2ec5-49f1-b972-8e898b0b39d0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 567.943171] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-8d647eeb-2ec5-49f1-b972-8e898b0b39d0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 567.943330] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d647eeb-2ec5-49f1-b972-8e898b0b39d0',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 568.210018] env[62842]: INFO networking_nsxv3.common.synchronization [req-336d903c-ce56-417b-81f4-07e1e65b94ae req-a55d22e5-d8e2-44b6-9541-40f7b61b113c tempest-MigrationsAdminTest-2116750055 tempest-MigrationsAdminTest-2116750055-project-member] Enqueued Resource ID: 38b4d382-6400-4588-b620-faecfba1fd64 with Priority: HIGHEST for action security_group_members [ 568.211332] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38b4d382-6400-4588-b620-faecfba1fd64 with Priority: HIGHEST for action security_group_members [ 568.211724] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-38b4d382-6400-4588-b620-faecfba1fd64 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.211847] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.211937] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.212215] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.212414] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.212539] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.212584] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.212747] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.212839] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 568.212926] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38b4d382-6400-4588-b620-faecfba1fd64',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 568.310716] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-b132ea78-a4b4-47a2-98dc-0d195c085bca taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.310925] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b132ea78-a4b4-47a2-98dc-0d195c085bca" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.310993] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b132ea78-a4b4-47a2-98dc-0d195c085bca" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.311257] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b132ea78-a4b4-47a2-98dc-0d195c085bca" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.311447] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.311649] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.311649] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.311851] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.311934] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 568.312084] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b132ea78-a4b4-47a2-98dc-0d195c085bca" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 568.312330] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-b132ea78-a4b4-47a2-98dc-0d195c085bca taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.312468] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b132ea78-a4b4-47a2-98dc-0d195c085bca" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.312559] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b132ea78-a4b4-47a2-98dc-0d195c085bca" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.312776] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b132ea78-a4b4-47a2-98dc-0d195c085bca" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.312993] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.313119] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.313215] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.313413] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.313563] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 568.314159] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b132ea78-a4b4-47a2-98dc-0d195c085bca" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 568.314419] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b132ea78-a4b4-47a2-98dc-0d195c085bca',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 568.388794] env[62842]: INFO networking_nsxv3.common.synchronization [req-92bf7ebc-5ca4-4960-ab6c-a28aa565b139 req-31f41890-527c-4614-b464-7485fb8f4ad8 service nova] Enqueued Resource ID: 473d98b1-ea12-43f6-8749-401a513b928c with Priority: HIGHEST for action security_group_rules [ 568.388794] env[62842]: INFO networking_nsxv3.common.synchronization [req-92bf7ebc-5ca4-4960-ab6c-a28aa565b139 req-31f41890-527c-4614-b464-7485fb8f4ad8 service nova] Enqueued Resource ID: 473d98b1-ea12-43f6-8749-401a513b928c with Priority: HIGHEST for action security_group_members [ 568.388794] env[62842]: INFO networking_nsxv3.common.synchronization [req-92bf7ebc-5ca4-4960-ab6c-a28aa565b139 req-31f41890-527c-4614-b464-7485fb8f4ad8 service nova] Enqueued Resource ID: 13be865a-3013-4611-b225-20bb12d5edaa with Priority: HIGHEST for action port [ 568.388794] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 473d98b1-ea12-43f6-8749-401a513b928c with Priority: HIGHEST for action security_group_rules [ 568.389145] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 473d98b1-ea12-43f6-8749-401a513b928c with Priority: HIGHEST for action security_group_members [ 568.389145] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13be865a-3013-4611-b225-20bb12d5edaa with Priority: HIGHEST for action port [ 568.389419] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-473d98b1-ea12-43f6-8749-401a513b928c taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.391214] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-473d98b1-ea12-43f6-8749-401a513b928c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.391214] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-473d98b1-ea12-43f6-8749-401a513b928c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.391214] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-473d98b1-ea12-43f6-8749-401a513b928c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.391214] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('473d98b1-ea12-43f6-8749-401a513b928c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 568.391214] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-473d98b1-ea12-43f6-8749-401a513b928c taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.391582] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-473d98b1-ea12-43f6-8749-401a513b928c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.391582] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-473d98b1-ea12-43f6-8749-401a513b928c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.391582] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-473d98b1-ea12-43f6-8749-401a513b928c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.391672] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.391842] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.391842] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.391934] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.392051] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 568.392138] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('473d98b1-ea12-43f6-8749-401a513b928c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 568.393497] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-13be865a-3013-4611-b225-20bb12d5edaa taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.393631] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-13be865a-3013-4611-b225-20bb12d5edaa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.393631] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-13be865a-3013-4611-b225-20bb12d5edaa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.393754] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-13be865a-3013-4611-b225-20bb12d5edaa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.393831] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13be865a-3013-4611-b225-20bb12d5edaa',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 568.448458] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.448458] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.448458] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.448817] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.449194] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 568.449270] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 8d647eeb-2ec5-49f1-b972-8e898b0b39d0 not found, creating... [ 568.449867] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.450425] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.450529] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.451418] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.451418] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 568.451686] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.452043] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.452217] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.452648] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.453624] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 568.453805] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 8d647eeb-2ec5-49f1-b972-8e898b0b39d0 is going to be created. [ 568.479115] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.479347] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.479513] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.479832] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.480090] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 568.480336] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-8d647eeb-2ec5-49f1-b972-8e898b0b39d0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 568.716693] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.716896] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.716970] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.717228] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.717325] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 568.717553] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.717655] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.717721] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.717872] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.717949] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 568.718047] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38b4d382-6400-4588-b620-faecfba1fd64 already deleted. [ 568.718129] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 568.817723] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b132ea78-a4b4-47a2-98dc-0d195c085bca: rpc.has_security_group_logging(os_id): False [ 568.842015] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.842015] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.842015] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.842015] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.842015] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 568.842015] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.842015] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.842015] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.842015] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.842015] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 568.842015] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.842015] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.842015] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.842015] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.842015] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 568.842567] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.842567] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.842567] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.842567] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.842567] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 568.842567] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b132ea78-a4b4-47a2-98dc-0d195c085bca is going to be created. [ 568.895594] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-473d98b1-ea12-43f6-8749-401a513b928c taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.897264] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-473d98b1-ea12-43f6-8749-401a513b928c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.897264] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('473d98b1-ea12-43f6-8749-401a513b928c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 568.898572] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 13be865a-3013-4611-b225-20bb12d5edaa with status ACTIVE [ 568.899205] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.899359] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.899408] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.899624] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.899726] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 568.899934] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.900176] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.900176] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.900244] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.900518] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 568.900580] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.900659] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.900764] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.900850] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.900989] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 568.901035] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 13be865a-3013-4611-b225-20bb12d5edaa is going to be updated. [ 568.912111] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.912299] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.912363] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.912532] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.912743] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 568.926914] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.926914] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.926914] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.926914] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.926914] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 568.926914] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-13be865a-3013-4611-b225-20bb12d5edaa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 568.928150] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b132ea78-a4b4-47a2-98dc-0d195c085bca in Status: IN_PROGRESS for 2s [ 569.403402] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('473d98b1-ea12-43f6-8749-401a513b928c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 569.575207] env[62842]: INFO networking_nsxv3.common.synchronization [None req-2823d15b-598a-4acf-8e50-1597b897db33 None None] Enqueued Resource ID: 29269992-844a-4a1a-acb4-da50b984a278 with Priority: HIGHEST for action port [ 569.577220] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29269992-844a-4a1a-acb4-da50b984a278 with Priority: HIGHEST for action port [ 569.577220] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-29269992-844a-4a1a-acb4-da50b984a278 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.578579] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-29269992-844a-4a1a-acb4-da50b984a278" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.578579] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-29269992-844a-4a1a-acb4-da50b984a278" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 569.578579] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-29269992-844a-4a1a-acb4-da50b984a278" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 569.578579] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29269992-844a-4a1a-acb4-da50b984a278',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 569.817153] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-938 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.817309] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-938" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.817496] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-938" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 569.817832] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-938" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 569.818474] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.818474] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.818474] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 569.819151] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 569.819151] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 569.819151] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 569.819151] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 569.819346] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 569.819400] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 569.819633] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 569.819735] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 569.819811] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 569.841239] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 569.841239] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 569.841239] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 569.841239] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-938" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 569.842182] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-2f67f60c-a6a9-4f9b-8e04-132d5074ae12 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.843376] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-2f67f60c-a6a9-4f9b-8e04-132d5074ae12" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.843376] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-2f67f60c-a6a9-4f9b-8e04-132d5074ae12" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 569.843376] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-2f67f60c-a6a9-4f9b-8e04-132d5074ae12" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 569.843893] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f67f60c-a6a9-4f9b-8e04-132d5074ae12',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 569.906075] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.906281] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.906362] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 569.906830] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 569.906830] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 569.906946] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 473d98b1-ea12-43f6-8749-401a513b928c is going to be created. [ 569.937105] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.937279] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.937600] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 569.937600] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 569.937799] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 569.953032] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 473d98b1-ea12-43f6-8749-401a513b928c in Status: UNINITIALIZED for 2s [ 570.083423] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 29269992-844a-4a1a-acb4-da50b984a278 [ 570.083828] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.087018] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.087018] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.087018] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.087018] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.087018] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:29269992-844a-4a1a-acb4-da50b984a278 already deleted. [ 570.087018] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-29269992-844a-4a1a-acb4-da50b984a278" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.346841] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.346948] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.347064] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.347297] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.348635] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.348635] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 2f67f60c-a6a9-4f9b-8e04-132d5074ae12 not found, creating... [ 570.348635] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.348635] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.348635] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.349029] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.349264] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.349571] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.349731] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.349867] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.353233] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.355103] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.355103] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 2f67f60c-a6a9-4f9b-8e04-132d5074ae12 is going to be created. [ 570.360793] env[62842]: INFO networking_nsxv3.common.synchronization [req-dbac47ac-90b1-4e97-b506-8b4282aa4c40 req-d7662978-61b3-4328-a78b-baccfeab9f2f service nova] Enqueued Resource ID: 3f89b292-3278-4b67-9a1b-21e48a9ef380 with Priority: HIGHEST for action security_group_rules [ 570.360793] env[62842]: INFO networking_nsxv3.common.synchronization [req-dbac47ac-90b1-4e97-b506-8b4282aa4c40 req-d7662978-61b3-4328-a78b-baccfeab9f2f service nova] Enqueued Resource ID: 3f89b292-3278-4b67-9a1b-21e48a9ef380 with Priority: HIGHEST for action security_group_members [ 570.360793] env[62842]: INFO networking_nsxv3.common.synchronization [req-dbac47ac-90b1-4e97-b506-8b4282aa4c40 req-d7662978-61b3-4328-a78b-baccfeab9f2f service nova] Enqueued Resource ID: 8d647eeb-2ec5-49f1-b972-8e898b0b39d0 with Priority: HIGHEST for action port [ 570.360793] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f89b292-3278-4b67-9a1b-21e48a9ef380 with Priority: HIGHEST for action security_group_rules [ 570.360793] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f89b292-3278-4b67-9a1b-21e48a9ef380 with Priority: HIGHEST for action security_group_members [ 570.360793] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d647eeb-2ec5-49f1-b972-8e898b0b39d0 with Priority: HIGHEST for action port [ 570.361190] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3f89b292-3278-4b67-9a1b-21e48a9ef380 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.361625] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3f89b292-3278-4b67-9a1b-21e48a9ef380" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.361625] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3f89b292-3278-4b67-9a1b-21e48a9ef380" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.361625] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3f89b292-3278-4b67-9a1b-21e48a9ef380" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.361857] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3f89b292-3278-4b67-9a1b-21e48a9ef380',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 570.367027] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f89b292-3278-4b67-9a1b-21e48a9ef380 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.367654] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f89b292-3278-4b67-9a1b-21e48a9ef380" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.367654] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f89b292-3278-4b67-9a1b-21e48a9ef380" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.367654] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f89b292-3278-4b67-9a1b-21e48a9ef380" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.368120] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.368242] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.368452] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.368581] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.369592] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.369592] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f89b292-3278-4b67-9a1b-21e48a9ef380',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 570.370840] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d647eeb-2ec5-49f1-b972-8e898b0b39d0 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.372062] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d647eeb-2ec5-49f1-b972-8e898b0b39d0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.372062] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d647eeb-2ec5-49f1-b972-8e898b0b39d0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.372062] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d647eeb-2ec5-49f1-b972-8e898b0b39d0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.372062] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d647eeb-2ec5-49f1-b972-8e898b0b39d0',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 570.375690] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.375690] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.375802] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.378981] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.378981] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.378981] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-2f67f60c-a6a9-4f9b-8e04-132d5074ae12" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.778108] env[62842]: INFO networking_nsxv3.common.synchronization [req-24658e25-be37-48e6-afc9-c9db123e24d3 req-be079358-9ab6-4d3f-874a-2fe428bf5679 tempest-ServersTestFqdnHostnames-908808954 tempest-ServersTestFqdnHostnames-908808954-project-member] Enqueued Resource ID: cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37 with Priority: HIGHEST for action security_group_members [ 570.781840] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37 with Priority: HIGHEST for action security_group_members [ 570.781840] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.781840] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.781840] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.781840] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.781840] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.781840] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.781840] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.781840] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.781840] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.781840] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 570.867635] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f89b292-3278-4b67-9a1b-21e48a9ef380 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.867635] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f89b292-3278-4b67-9a1b-21e48a9ef380" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.872714] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3f89b292-3278-4b67-9a1b-21e48a9ef380',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 570.874959] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8d647eeb-2ec5-49f1-b972-8e898b0b39d0 with status ACTIVE [ 570.875171] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.875348] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.875429] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.875581] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.875668] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.876015] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.876015] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.876015] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.876149] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.876221] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.876400] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.876494] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.876553] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.876689] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.876760] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.876843] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8d647eeb-2ec5-49f1-b972-8e898b0b39d0 is going to be updated. [ 570.903345] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.903345] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.903345] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.903345] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.903345] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.903345] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d647eeb-2ec5-49f1-b972-8e898b0b39d0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.944767] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b132ea78-a4b4-47a2-98dc-0d195c085bca in Status: SUCCESS [ 570.944878] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b132ea78-a4b4-47a2-98dc-0d195c085bca" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.207412] env[62842]: INFO networking_nsxv3.common.synchronization [None req-f1d12acf-77dd-4733-9222-b4951ea3cca7 None None] Enqueued Resource ID: aba5a059-13d5-4604-bea2-81c9df841791 with Priority: HIGHEST for action port [ 571.208099] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aba5a059-13d5-4604-bea2-81c9df841791 with Priority: HIGHEST for action port [ 571.208494] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-aba5a059-13d5-4604-bea2-81c9df841791 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.208707] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aba5a059-13d5-4604-bea2-81c9df841791" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.208768] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aba5a059-13d5-4604-bea2-81c9df841791" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.209607] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aba5a059-13d5-4604-bea2-81c9df841791" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.209607] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aba5a059-13d5-4604-bea2-81c9df841791',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 571.231194] env[62842]: INFO networking_nsxv3.common.synchronization [None req-68b097ba-868f-46a6-b8ae-75e6ac99dc2d None None] Enqueued Resource ID: ca94c18d-bd4c-41de-8322-a41855e8efc8 with Priority: HIGHEST for action port [ 571.231194] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca94c18d-bd4c-41de-8322-a41855e8efc8 with Priority: HIGHEST for action port [ 571.232497] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca94c18d-bd4c-41de-8322-a41855e8efc8 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.232855] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca94c18d-bd4c-41de-8322-a41855e8efc8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.233219] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca94c18d-bd4c-41de-8322-a41855e8efc8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.234929] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca94c18d-bd4c-41de-8322-a41855e8efc8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.234929] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca94c18d-bd4c-41de-8322-a41855e8efc8',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 571.285975] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.286264] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.286444] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.286658] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.287071] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.287348] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.287678] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.287761] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.287939] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.288040] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.288134] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37 already deleted. [ 571.288215] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.375386] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3f89b292-3278-4b67-9a1b-21e48a9ef380',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 571.600758] env[62842]: INFO networking_nsxv3.common.synchronization [None req-dcda148b-8986-4bf2-ada1-7acaf70b8183 None None] Enqueued Resource ID: 44cd13b1-a5b7-4340-a148-791d90b4033b with Priority: HIGHEST for action port [ 571.604998] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44cd13b1-a5b7-4340-a148-791d90b4033b with Priority: HIGHEST for action port [ 571.605850] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-44cd13b1-a5b7-4340-a148-791d90b4033b taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.605934] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-44cd13b1-a5b7-4340-a148-791d90b4033b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.605934] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-44cd13b1-a5b7-4340-a148-791d90b4033b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.606416] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-44cd13b1-a5b7-4340-a148-791d90b4033b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.606472] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44cd13b1-a5b7-4340-a148-791d90b4033b',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 571.712634] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aba5a059-13d5-4604-bea2-81c9df841791 [ 571.712634] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.712634] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.712634] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.712971] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.712971] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.713047] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aba5a059-13d5-4604-bea2-81c9df841791 already deleted. [ 571.713133] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aba5a059-13d5-4604-bea2-81c9df841791" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.736513] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ca94c18d-bd4c-41de-8322-a41855e8efc8 [ 571.736744] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.737039] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.737039] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.737306] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.737306] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.737367] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ca94c18d-bd4c-41de-8322-a41855e8efc8 already deleted. [ 571.737473] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca94c18d-bd4c-41de-8322-a41855e8efc8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.769784] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-243 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.769784] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-243" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.769784] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-243" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.769784] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-243" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.769784] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.769784] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.770407] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.770744] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.770998] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.771314] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 571.771538] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 571.771827] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 571.772145] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 571.772429] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 571.772645] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 571.774626] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 571.795331] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 571.795732] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 571.795732] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 571.796365] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-243" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.796854] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-68382e88-f152-4672-b8be-a97d14775421 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.796854] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-68382e88-f152-4672-b8be-a97d14775421" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.796854] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-68382e88-f152-4672-b8be-a97d14775421" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.797188] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-68382e88-f152-4672-b8be-a97d14775421" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.797188] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68382e88-f152-4672-b8be-a97d14775421',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 571.880874] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.882630] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.882630] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.882630] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.882630] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.882630] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f89b292-3278-4b67-9a1b-21e48a9ef380 is going to be created. [ 571.908294] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.908478] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.908556] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.908787] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.908952] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.920202] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f89b292-3278-4b67-9a1b-21e48a9ef380 in Status: UNINITIALIZED for 2s [ 571.963647] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 473d98b1-ea12-43f6-8749-401a513b928c in Status: SUCCESS [ 571.964966] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-473d98b1-ea12-43f6-8749-401a513b928c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.964966] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-473d98b1-ea12-43f6-8749-401a513b928c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.964966] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-473d98b1-ea12-43f6-8749-401a513b928c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.964966] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.964966] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.964966] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.965418] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.965499] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.965591] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-473d98b1-ea12-43f6-8749-401a513b928c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.965737] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('473d98b1-ea12-43f6-8749-401a513b928c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 572.028323] env[62842]: INFO networking_nsxv3.common.synchronization [None req-0af0dee7-a84b-4130-a43c-59bcdc64d722 tempest-ServerActionsTestOtherA-1611322165 tempest-ServerActionsTestOtherA-1611322165-project-member] Enqueued Resource ID: 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 with Priority: HIGHEST for action security_group_rules [ 572.028887] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 with Priority: HIGHEST for action security_group_rules [ 572.029208] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.029322] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.029393] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.029639] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.029722] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 572.087472] env[62842]: INFO networking_nsxv3.common.synchronization [req-336d903c-ce56-417b-81f4-07e1e65b94ae req-90d466aa-519b-43c5-8d38-13e500e0ee05 service nova] Enqueued Resource ID: 38b4d382-6400-4588-b620-faecfba1fd64 with Priority: HIGHEST for action security_group_rules [ 572.087970] env[62842]: INFO networking_nsxv3.common.synchronization [req-336d903c-ce56-417b-81f4-07e1e65b94ae req-90d466aa-519b-43c5-8d38-13e500e0ee05 service nova] Enqueued Resource ID: 38b4d382-6400-4588-b620-faecfba1fd64 with Priority: HIGHEST for action security_group_members [ 572.087970] env[62842]: INFO networking_nsxv3.common.synchronization [req-336d903c-ce56-417b-81f4-07e1e65b94ae req-90d466aa-519b-43c5-8d38-13e500e0ee05 service nova] Enqueued Resource ID: 2f67f60c-a6a9-4f9b-8e04-132d5074ae12 with Priority: HIGHEST for action port [ 572.087970] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38b4d382-6400-4588-b620-faecfba1fd64 with Priority: HIGHEST for action security_group_rules [ 572.088166] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38b4d382-6400-4588-b620-faecfba1fd64 with Priority: HIGHEST for action security_group_members [ 572.089835] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f67f60c-a6a9-4f9b-8e04-132d5074ae12 with Priority: HIGHEST for action port [ 572.090334] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-38b4d382-6400-4588-b620-faecfba1fd64 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.090334] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.090334] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.090334] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.090334] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('38b4d382-6400-4588-b620-faecfba1fd64',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 572.092738] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-38b4d382-6400-4588-b620-faecfba1fd64 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.092738] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.092738] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.092949] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.093360] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.093479] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.094039] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.094039] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.094039] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.094039] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38b4d382-6400-4588-b620-faecfba1fd64',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 572.095189] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f67f60c-a6a9-4f9b-8e04-132d5074ae12 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.095302] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f67f60c-a6a9-4f9b-8e04-132d5074ae12" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.095400] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f67f60c-a6a9-4f9b-8e04-132d5074ae12" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.095574] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f67f60c-a6a9-4f9b-8e04-132d5074ae12" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.095654] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f67f60c-a6a9-4f9b-8e04-132d5074ae12',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 572.111268] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 44cd13b1-a5b7-4340-a148-791d90b4033b [ 572.111268] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.111268] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.111268] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.111268] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.111268] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.111268] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:44cd13b1-a5b7-4340-a148-791d90b4033b already deleted. [ 572.111268] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-44cd13b1-a5b7-4340-a148-791d90b4033b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.300182] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.300399] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.300747] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.301189] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.301348] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.301514] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 68382e88-f152-4672-b8be-a97d14775421 not found, creating... [ 572.306072] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.306535] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.306535] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.307335] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.307335] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.307529] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.307826] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.307826] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.310570] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.310570] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.310570] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 68382e88-f152-4672-b8be-a97d14775421 is going to be created. [ 572.331761] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.331985] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.332127] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.332396] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.332626] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.332842] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-68382e88-f152-4672-b8be-a97d14775421" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.351722] env[62842]: INFO networking_nsxv3.common.synchronization [None req-2c98a45b-da91-4606-ae06-3bee305079e6 tempest-ServerActionsTestOtherA-1611322165 tempest-ServerActionsTestOtherA-1611322165-project-member] Enqueued Resource ID: 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 with Priority: HIGHEST for action security_group_rules [ 572.352683] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 with Priority: HIGHEST for action security_group_rules [ 572.352963] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.353080] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.468185] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-473d98b1-ea12-43f6-8749-401a513b928c taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.468577] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-473d98b1-ea12-43f6-8749-401a513b928c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.468617] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-473d98b1-ea12-43f6-8749-401a513b928c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.468838] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-473d98b1-ea12-43f6-8749-401a513b928c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.469040] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.471389] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.471389] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.471389] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.471389] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.471389] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-473d98b1-ea12-43f6-8749-401a513b928c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.471389] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-473d98b1-ea12-43f6-8749-401a513b928c taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.471389] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-473d98b1-ea12-43f6-8749-401a513b928c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.471389] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-473d98b1-ea12-43f6-8749-401a513b928c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.471389] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-473d98b1-ea12-43f6-8749-401a513b928c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.471389] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.471389] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.471389] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.471389] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.471389] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.471389] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-473d98b1-ea12-43f6-8749-401a513b928c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.471389] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('473d98b1-ea12-43f6-8749-401a513b928c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 572.539704] env[62842]: INFO networking_nsxv3.common.synchronization [req-f087313d-35a4-4bcf-b07e-ba4127ee48a1 req-28ff8bfc-5207-4cf4-84e8-2026568f2efb tempest-AttachVolumeShelveTestJSON-759972748 tempest-AttachVolumeShelveTestJSON-759972748-project-member] Enqueued Resource ID: e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55 with Priority: HIGHEST for action security_group_members [ 572.540000] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55 with Priority: HIGHEST for action security_group_members [ 572.540322] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.542572] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.542572] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.542572] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.542572] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.542572] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.542572] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.542572] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.542572] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.542572] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 572.553284] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.553516] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.553516] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.553992] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.553992] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.553992] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 already deleted. [ 572.553992] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.554289] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.554289] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.554386] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 572.597920] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-38b4d382-6400-4588-b620-faecfba1fd64 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.598130] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.600855] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('38b4d382-6400-4588-b620-faecfba1fd64',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 572.602310] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2f67f60c-a6a9-4f9b-8e04-132d5074ae12 with status ACTIVE [ 572.602933] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.603135] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.603233] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.607082] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.607212] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.607502] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.607627] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.607693] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.607882] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.607964] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.608955] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.609111] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.609179] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.609357] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.609437] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.609531] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2f67f60c-a6a9-4f9b-8e04-132d5074ae12 is going to be updated. [ 572.644242] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.644242] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.644242] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.644242] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.644242] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.644242] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f67f60c-a6a9-4f9b-8e04-132d5074ae12" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.974063] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 473d98b1-ea12-43f6-8749-401a513b928c: rpc.has_security_group_logging(os_id): False [ 573.000163] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.001032] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.001032] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.001032] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.001032] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.001032] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.001032] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.001298] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.001455] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.001548] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.001839] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.001932] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.001981] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.002155] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.002231] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.002433] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.003666] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.003666] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.003666] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.003666] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.003666] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 473d98b1-ea12-43f6-8749-401a513b928c is going to be created. [ 573.044234] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.044465] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.044519] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.045171] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.045171] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.045171] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.045294] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.045624] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.045624] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.045750] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.045750] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55 already deleted. [ 573.045810] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.084569] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.084825] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.084922] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.085252] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.086147] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.086147] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 already deleted. [ 573.086147] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.099027] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.099027] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.099027] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.099376] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.099376] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.112382] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('38b4d382-6400-4588-b620-faecfba1fd64',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 573.119103] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 473d98b1-ea12-43f6-8749-401a513b928c in Status: IN_PROGRESS for 2s [ 573.290245] env[62842]: INFO networking_nsxv3.common.synchronization [None req-7de17178-1227-4cc4-b857-d93c5dfac117 None None] Enqueued Resource ID: 1bc4a205-b5fa-4977-857c-f2fd935fc80e with Priority: HIGHEST for action port [ 573.290245] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bc4a205-b5fa-4977-857c-f2fd935fc80e with Priority: HIGHEST for action port [ 573.291677] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-1bc4a205-b5fa-4977-857c-f2fd935fc80e taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.291861] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1bc4a205-b5fa-4977-857c-f2fd935fc80e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.291934] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1bc4a205-b5fa-4977-857c-f2fd935fc80e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.292258] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1bc4a205-b5fa-4977-857c-f2fd935fc80e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.292441] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1bc4a205-b5fa-4977-857c-f2fd935fc80e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 573.619576] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.619576] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.619576] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.619576] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.619576] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.619576] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38b4d382-6400-4588-b620-faecfba1fd64 is going to be created. [ 573.650350] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.650350] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.650350] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.650350] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.650350] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.662392] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38b4d382-6400-4588-b620-faecfba1fd64 in Status: UNINITIALIZED for 2s [ 573.695412] env[62842]: INFO networking_nsxv3.common.synchronization [None req-06e7e2df-b7a0-4b6a-bd80-05da487e771f None None] Enqueued Resource ID: 3db55fab-2f23-49a2-a094-e990c9197047 with Priority: HIGHEST for action port [ 573.695690] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3db55fab-2f23-49a2-a094-e990c9197047 with Priority: HIGHEST for action port [ 573.697707] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-3db55fab-2f23-49a2-a094-e990c9197047 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.697886] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3db55fab-2f23-49a2-a094-e990c9197047" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.697971] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3db55fab-2f23-49a2-a094-e990c9197047" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.698242] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3db55fab-2f23-49a2-a094-e990c9197047" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.698338] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3db55fab-2f23-49a2-a094-e990c9197047',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 573.794522] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1bc4a205-b5fa-4977-857c-f2fd935fc80e [ 573.795096] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.796845] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.796845] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.796845] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.797176] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.797176] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1bc4a205-b5fa-4977-857c-f2fd935fc80e already deleted. [ 573.797176] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1bc4a205-b5fa-4977-857c-f2fd935fc80e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.934007] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f89b292-3278-4b67-9a1b-21e48a9ef380 in Status: SUCCESS [ 573.934232] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f89b292-3278-4b67-9a1b-21e48a9ef380" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.934398] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f89b292-3278-4b67-9a1b-21e48a9ef380" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.934602] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f89b292-3278-4b67-9a1b-21e48a9ef380" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.935269] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.935269] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.935269] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.935269] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.935269] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.935531] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f89b292-3278-4b67-9a1b-21e48a9ef380" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.935531] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3f89b292-3278-4b67-9a1b-21e48a9ef380',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.088023] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-434 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.088023] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-434" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.088023] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-434" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.088023] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-434" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.088023] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.088023] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.088023] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.088833] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.088833] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.088833] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 574.088833] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 574.088833] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 574.088980] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 574.089057] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 574.089169] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 574.089307] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 574.114649] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 574.114649] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 574.114931] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 574.114931] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-434" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.116208] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-b699876b-60f0-416e-9f34-d7f4c37bde78 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.116208] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-b699876b-60f0-416e-9f34-d7f4c37bde78" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.116208] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-b699876b-60f0-416e-9f34-d7f4c37bde78" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.116208] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-b699876b-60f0-416e-9f34-d7f4c37bde78" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.116471] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b699876b-60f0-416e-9f34-d7f4c37bde78',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.200871] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3db55fab-2f23-49a2-a094-e990c9197047 [ 574.201285] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.201285] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.201470] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.202046] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.202046] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.202046] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3db55fab-2f23-49a2-a094-e990c9197047 already deleted. [ 574.202046] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3db55fab-2f23-49a2-a094-e990c9197047" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.214480] env[62842]: INFO networking_nsxv3.common.synchronization [req-24658e25-be37-48e6-afc9-c9db123e24d3 req-98c8df22-8867-482b-8661-6acea919cfd3 service nova] Enqueued Resource ID: cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37 with Priority: HIGHEST for action security_group_rules [ 574.214652] env[62842]: INFO networking_nsxv3.common.synchronization [req-24658e25-be37-48e6-afc9-c9db123e24d3 req-98c8df22-8867-482b-8661-6acea919cfd3 service nova] Enqueued Resource ID: cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37 with Priority: HIGHEST for action security_group_members [ 574.214786] env[62842]: INFO networking_nsxv3.common.synchronization [req-24658e25-be37-48e6-afc9-c9db123e24d3 req-98c8df22-8867-482b-8661-6acea919cfd3 service nova] Enqueued Resource ID: 68382e88-f152-4672-b8be-a97d14775421 with Priority: HIGHEST for action port [ 574.215308] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37 with Priority: HIGHEST for action security_group_rules [ 574.215450] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37 with Priority: HIGHEST for action security_group_members [ 574.215547] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68382e88-f152-4672-b8be-a97d14775421 with Priority: HIGHEST for action port [ 574.215815] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.219264] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.219322] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.219540] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.219628] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.220582] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.220680] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.220748] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.220913] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.221078] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.221176] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.221238] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.221375] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.221460] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.221553] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.222400] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-68382e88-f152-4672-b8be-a97d14775421 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.222529] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68382e88-f152-4672-b8be-a97d14775421" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.222529] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68382e88-f152-4672-b8be-a97d14775421" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.222657] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68382e88-f152-4672-b8be-a97d14775421" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.222722] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68382e88-f152-4672-b8be-a97d14775421',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.440740] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f89b292-3278-4b67-9a1b-21e48a9ef380 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.440740] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f89b292-3278-4b67-9a1b-21e48a9ef380" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.440740] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f89b292-3278-4b67-9a1b-21e48a9ef380" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.440987] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f89b292-3278-4b67-9a1b-21e48a9ef380" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.441581] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.441698] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.441698] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.442370] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.442370] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.442370] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f89b292-3278-4b67-9a1b-21e48a9ef380" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.442370] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f89b292-3278-4b67-9a1b-21e48a9ef380 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.442370] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f89b292-3278-4b67-9a1b-21e48a9ef380" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.442370] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f89b292-3278-4b67-9a1b-21e48a9ef380" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.442593] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f89b292-3278-4b67-9a1b-21e48a9ef380" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.442854] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.442854] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.442854] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.443234] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.443316] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.443401] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f89b292-3278-4b67-9a1b-21e48a9ef380" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.443518] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3f89b292-3278-4b67-9a1b-21e48a9ef380',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.620207] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.620207] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.620207] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.620207] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.620207] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.620207] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port b699876b-60f0-416e-9f34-d7f4c37bde78 not found, creating... [ 574.620207] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.621821] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.621821] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.621821] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.621821] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.621821] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.621821] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.621821] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.621821] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.621821] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.621821] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: b699876b-60f0-416e-9f34-d7f4c37bde78 is going to be created. [ 574.650649] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.655197] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.655421] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.655722] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.655955] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.656217] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-b699876b-60f0-416e-9f34-d7f4c37bde78" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.725068] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.726472] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.726600] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.726751] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 68382e88-f152-4672-b8be-a97d14775421 with status ACTIVE [ 574.726899] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.726998] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.727074] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.727279] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.727365] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.727576] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.727669] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.727727] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.727947] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.728078] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.728647] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.728764] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.728803] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.730279] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.730279] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.730279] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 68382e88-f152-4672-b8be-a97d14775421 is going to be updated. [ 574.766813] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.766813] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.766813] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.766813] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.766813] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.766813] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68382e88-f152-4672-b8be-a97d14775421" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.946034] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3f89b292-3278-4b67-9a1b-21e48a9ef380: rpc.has_security_group_logging(os_id): False [ 574.969088] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.969728] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.969980] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.970242] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.970341] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.970840] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.970840] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.970840] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.971125] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.971211] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.971818] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.971818] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.971818] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.971818] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.971818] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.972108] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.972108] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.972108] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.972324] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.972324] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.972431] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3f89b292-3278-4b67-9a1b-21e48a9ef380 is going to be created. [ 575.043104] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.043104] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.043104] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.043104] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.043104] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.055835] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3f89b292-3278-4b67-9a1b-21e48a9ef380 in Status: IN_PROGRESS for 2s [ 575.137300] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 473d98b1-ea12-43f6-8749-401a513b928c in Status: SUCCESS [ 575.137723] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-473d98b1-ea12-43f6-8749-401a513b928c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.231987] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.307085] env[62842]: INFO networking_nsxv3.common.synchronization [req-b918cdef-d342-4780-8490-9d8de2440904 req-a8c7adbe-f4ff-41a8-84ea-b1b6194ba98a tempest-DeleteServersAdminTestJSON-1068454179 tempest-DeleteServersAdminTestJSON-1068454179-project-admin] Enqueued Resource ID: d014d213-d805-403a-bcc9-8c66da8eefa2 with Priority: HIGHEST for action security_group_members [ 575.307855] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d014d213-d805-403a-bcc9-8c66da8eefa2 with Priority: HIGHEST for action security_group_members [ 575.308112] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-d014d213-d805-403a-bcc9-8c66da8eefa2 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.308247] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.308317] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.308644] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.308771] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.308771] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.308915] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.308961] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.309276] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.309854] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d014d213-d805-403a-bcc9-8c66da8eefa2',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.469905] env[62842]: INFO networking_nsxv3.common.synchronization [None req-9d7ab19b-7b7a-41c2-9c75-9686857edcf2 None None] Enqueued Resource ID: 750cf7dd-b096-4d4c-83b1-1f12adce160f with Priority: HIGHEST for action port [ 575.470498] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 750cf7dd-b096-4d4c-83b1-1f12adce160f with Priority: HIGHEST for action port [ 575.470815] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-750cf7dd-b096-4d4c-83b1-1f12adce160f taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.470937] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-750cf7dd-b096-4d4c-83b1-1f12adce160f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.470999] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-750cf7dd-b096-4d4c-83b1-1f12adce160f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.471285] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-750cf7dd-b096-4d4c-83b1-1f12adce160f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.471404] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('750cf7dd-b096-4d4c-83b1-1f12adce160f',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.676713] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38b4d382-6400-4588-b620-faecfba1fd64 in Status: SUCCESS [ 575.676713] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.676713] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.676713] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.676713] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.676713] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.676713] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.676713] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.676713] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.676713] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.676713] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('38b4d382-6400-4588-b620-faecfba1fd64',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.740864] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.740864] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.740864] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.740864] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.740864] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.740864] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37 is going to be created. [ 575.744696] env[62842]: INFO networking_nsxv3.common.synchronization [None req-ea2fc00a-affe-4f4d-a394-567f5c9511dc tempest-VolumesAssistedSnapshotsTest-756271320 tempest-VolumesAssistedSnapshotsTest-756271320-project-member] Enqueued Resource ID: 92cba5b3-76df-405c-acab-0f3155ce22e5 with Priority: HIGHEST for action security_group_rules [ 575.746553] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92cba5b3-76df-405c-acab-0f3155ce22e5 with Priority: HIGHEST for action security_group_rules [ 575.746553] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-92cba5b3-76df-405c-acab-0f3155ce22e5 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.746967] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-92cba5b3-76df-405c-acab-0f3155ce22e5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.747192] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-92cba5b3-76df-405c-acab-0f3155ce22e5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.747578] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-92cba5b3-76df-405c-acab-0f3155ce22e5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.748893] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('92cba5b3-76df-405c-acab-0f3155ce22e5',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.768075] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.768075] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.768075] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.769134] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.769134] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.783281] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37 in Status: UNINITIALIZED for 2s [ 575.814827] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.815097] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.815223] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.815552] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.815750] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.815997] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.816172] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.816277] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.816529] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.816661] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.816823] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d014d213-d805-403a-bcc9-8c66da8eefa2 is going to be updated. [ 575.850032] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.850187] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.850187] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.850667] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.850667] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.860583] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d014d213-d805-403a-bcc9-8c66da8eefa2 in Status: IN_PROGRESS for 2s [ 575.954976] env[62842]: INFO networking_nsxv3.common.synchronization [req-7a36a38d-2454-4912-9539-615addf484d2 req-aeec994a-5595-4b42-80d7-7befd850dd59 tempest-SecurityGroupsTestJSON-1354345429 tempest-SecurityGroupsTestJSON-1354345429-project-member] Enqueued Resource ID: 5704e4e3-8211-4e30-b474-06c668cf060d with Priority: HIGHEST for action security_group_members [ 575.954976] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5704e4e3-8211-4e30-b474-06c668cf060d with Priority: HIGHEST for action security_group_members [ 575.954976] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5704e4e3-8211-4e30-b474-06c668cf060d taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.954976] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.954976] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.955680] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.956449] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.956716] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.956860] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.957128] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.957304] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.957890] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5704e4e3-8211-4e30-b474-06c668cf060d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.973634] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 750cf7dd-b096-4d4c-83b1-1f12adce160f [ 575.973886] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.974023] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.974091] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.974301] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.974410] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.974476] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:750cf7dd-b096-4d4c-83b1-1f12adce160f already deleted. [ 575.974959] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-750cf7dd-b096-4d4c-83b1-1f12adce160f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.180330] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-38b4d382-6400-4588-b620-faecfba1fd64 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.180330] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.180330] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.180330] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.180749] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.180749] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.180749] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.180749] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.180904] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.180904] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.181471] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-38b4d382-6400-4588-b620-faecfba1fd64 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.181471] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.181471] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.181471] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.181471] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.181695] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.181695] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.181695] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.181784] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.181834] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.181939] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('38b4d382-6400-4588-b620-faecfba1fd64',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.273288] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.273497] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.273586] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.273826] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.274662] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.274761] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 92cba5b3-76df-405c-acab-0f3155ce22e5 already deleted. [ 576.274903] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-92cba5b3-76df-405c-acab-0f3155ce22e5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.354360] env[62842]: INFO networking_nsxv3.common.synchronization [None req-4f9dfe96-6595-435b-8ef0-06d0a6527ae6 tempest-VolumesAssistedSnapshotsTest-756271320 tempest-VolumesAssistedSnapshotsTest-756271320-project-member] Enqueued Resource ID: 92cba5b3-76df-405c-acab-0f3155ce22e5 with Priority: HIGHEST for action security_group_rules [ 576.354360] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92cba5b3-76df-405c-acab-0f3155ce22e5 with Priority: HIGHEST for action security_group_rules [ 576.354360] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-92cba5b3-76df-405c-acab-0f3155ce22e5 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.354360] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-92cba5b3-76df-405c-acab-0f3155ce22e5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.356785] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-92cba5b3-76df-405c-acab-0f3155ce22e5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.356785] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-92cba5b3-76df-405c-acab-0f3155ce22e5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.356785] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('92cba5b3-76df-405c-acab-0f3155ce22e5',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.461508] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.461739] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.461844] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.462177] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.462319] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.462612] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.462763] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.462854] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.463111] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.463228] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.463356] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5704e4e3-8211-4e30-b474-06c668cf060d already deleted. [ 576.463479] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.685975] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 38b4d382-6400-4588-b620-faecfba1fd64: rpc.has_security_group_logging(os_id): False [ 576.711159] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.711298] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.711351] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.711586] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.713296] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.713296] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.713296] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.713296] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.713296] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.713296] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.713296] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.713296] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.713296] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.713296] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.713296] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.713296] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.714340] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.714340] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.714340] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.714340] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.714340] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 38b4d382-6400-4588-b620-faecfba1fd64 is going to be created. [ 576.801320] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.801558] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.801558] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.801800] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.801997] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.858150] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 38b4d382-6400-4588-b620-faecfba1fd64 in Status: IN_PROGRESS for 2s [ 576.883811] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.884056] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.884056] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.884500] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.884610] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.884843] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 92cba5b3-76df-405c-acab-0f3155ce22e5 already deleted. [ 576.884944] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-92cba5b3-76df-405c-acab-0f3155ce22e5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.928024] env[62842]: INFO networking_nsxv3.common.synchronization [req-f087313d-35a4-4bcf-b07e-ba4127ee48a1 req-b66ee268-92f2-478f-a81a-b8006b70ad0f service nova] Enqueued Resource ID: e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55 with Priority: HIGHEST for action security_group_rules [ 576.928024] env[62842]: INFO networking_nsxv3.common.synchronization [req-f087313d-35a4-4bcf-b07e-ba4127ee48a1 req-b66ee268-92f2-478f-a81a-b8006b70ad0f service nova] Enqueued Resource ID: e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55 with Priority: HIGHEST for action security_group_members [ 576.928024] env[62842]: INFO networking_nsxv3.common.synchronization [req-f087313d-35a4-4bcf-b07e-ba4127ee48a1 req-b66ee268-92f2-478f-a81a-b8006b70ad0f service nova] Enqueued Resource ID: b699876b-60f0-416e-9f34-d7f4c37bde78 with Priority: HIGHEST for action port [ 576.931962] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55 with Priority: HIGHEST for action security_group_rules [ 576.931962] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55 with Priority: HIGHEST for action security_group_members [ 576.931962] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b699876b-60f0-416e-9f34-d7f4c37bde78 with Priority: HIGHEST for action port [ 576.931962] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.931962] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.931962] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.931962] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.931962] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.931962] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.931962] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.931962] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.931962] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.933816] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.934228] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.934521] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.935032] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.935363] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.935583] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.937187] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-b699876b-60f0-416e-9f34-d7f4c37bde78 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.937569] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b699876b-60f0-416e-9f34-d7f4c37bde78" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.938223] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b699876b-60f0-416e-9f34-d7f4c37bde78" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.939126] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b699876b-60f0-416e-9f34-d7f4c37bde78" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.939126] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b699876b-60f0-416e-9f34-d7f4c37bde78',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.075115] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3f89b292-3278-4b67-9a1b-21e48a9ef380 in Status: SUCCESS [ 577.076053] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3f89b292-3278-4b67-9a1b-21e48a9ef380" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.389327] env[62842]: INFO networking_nsxv3.common.synchronization [None req-a1515950-8d12-4905-858f-7eea6c589f07 tempest-ServersWithSpecificFlavorTestJSON-2019624802 tempest-ServersWithSpecificFlavorTestJSON-2019624802-project-member] Enqueued Resource ID: 16baecd6-bda3-40e1-98ef-4e238a3fc354 with Priority: HIGHEST for action security_group_rules [ 577.389629] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16baecd6-bda3-40e1-98ef-4e238a3fc354 with Priority: HIGHEST for action security_group_rules [ 577.390586] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16baecd6-bda3-40e1-98ef-4e238a3fc354 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.390586] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16baecd6-bda3-40e1-98ef-4e238a3fc354" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.390586] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16baecd6-bda3-40e1-98ef-4e238a3fc354" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.390586] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16baecd6-bda3-40e1-98ef-4e238a3fc354" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.390586] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16baecd6-bda3-40e1-98ef-4e238a3fc354',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.441870] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.444911] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.444911] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.445212] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b699876b-60f0-416e-9f34-d7f4c37bde78 with status ACTIVE [ 577.445329] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.445525] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.445623] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.445918] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.446339] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.446665] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.446831] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.446930] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.447987] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.447987] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.448247] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.448407] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.448513] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.448770] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.448887] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.449049] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b699876b-60f0-416e-9f34-d7f4c37bde78 is going to be updated. [ 577.476323] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.476323] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.476323] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.476323] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.476323] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.476323] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b699876b-60f0-416e-9f34-d7f4c37bde78" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.778873] env[62842]: INFO networking_nsxv3.common.synchronization [None req-1af93be9-87fc-4581-90da-5783e6f0c843 tempest-ServersWithSpecificFlavorTestJSON-2019624802 tempest-ServersWithSpecificFlavorTestJSON-2019624802-project-member] Enqueued Resource ID: 16baecd6-bda3-40e1-98ef-4e238a3fc354 with Priority: HIGHEST for action security_group_rules [ 577.782037] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16baecd6-bda3-40e1-98ef-4e238a3fc354 with Priority: HIGHEST for action security_group_rules [ 577.782037] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16baecd6-bda3-40e1-98ef-4e238a3fc354 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.782037] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16baecd6-bda3-40e1-98ef-4e238a3fc354" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.794597] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37 in Status: SUCCESS [ 577.794597] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.794830] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.794966] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.795206] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.795382] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.795680] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.795873] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.795974] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.796081] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.796251] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.872119] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-594 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.872327] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-594" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.872836] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-594" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.873292] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-594" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.873636] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.873880] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.874805] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.874888] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.875254] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.875563] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 577.875711] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 577.875847] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 577.876000] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 577.876165] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 577.876296] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 577.876669] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 577.879653] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d014d213-d805-403a-bcc9-8c66da8eefa2 in Status: SUCCESS [ 577.879875] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d014d213-d805-403a-bcc9-8c66da8eefa2 deletion is rescheduled due to dependency. [ 577.880192] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.891713] env[62842]: INFO networking_nsxv3.common.synchronization [None req-211b1276-f3ec-48a6-876f-da9fbaf7b766 None None] Enqueued Resource ID: 23a9e698-5432-431f-81c8-a200fd4ab0a4 with Priority: HIGHEST for action port [ 577.892089] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23a9e698-5432-431f-81c8-a200fd4ab0a4 with Priority: HIGHEST for action port [ 577.896050] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-23a9e698-5432-431f-81c8-a200fd4ab0a4 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.897444] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23a9e698-5432-431f-81c8-a200fd4ab0a4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.897444] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23a9e698-5432-431f-81c8-a200fd4ab0a4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.897444] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23a9e698-5432-431f-81c8-a200fd4ab0a4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.897654] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23a9e698-5432-431f-81c8-a200fd4ab0a4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.900760] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 577.901041] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 577.901367] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 577.901493] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-594" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.901749] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-7f647998-9191-4369-9965-13391731c919 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.901938] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-7f647998-9191-4369-9965-13391731c919" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.902066] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-7f647998-9191-4369-9965-13391731c919" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.902378] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-7f647998-9191-4369-9965-13391731c919" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.902537] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f647998-9191-4369-9965-13391731c919',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.916891] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.917049] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.917408] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.917697] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.917799] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.917904] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16baecd6-bda3-40e1-98ef-4e238a3fc354 already deleted. [ 577.918016] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16baecd6-bda3-40e1-98ef-4e238a3fc354" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.918777] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16baecd6-bda3-40e1-98ef-4e238a3fc354" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.918981] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16baecd6-bda3-40e1-98ef-4e238a3fc354" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.919251] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16baecd6-bda3-40e1-98ef-4e238a3fc354',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.945745] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.299242] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.400023] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 23a9e698-5432-431f-81c8-a200fd4ab0a4 [ 578.400712] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.400983] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.401154] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.401472] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.401676] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.401963] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:23a9e698-5432-431f-81c8-a200fd4ab0a4 already deleted. [ 578.402149] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23a9e698-5432-431f-81c8-a200fd4ab0a4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.407705] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.407705] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.407705] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.407705] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.407705] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.407705] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 7f647998-9191-4369-9965-13391731c919 not found, creating... [ 578.407705] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.407705] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.407705] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.407705] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.407705] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.410904] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.411430] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.412675] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.413178] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.416946] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.416946] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 7f647998-9191-4369-9965-13391731c919 is going to be created. [ 578.452853] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.452853] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.452853] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.452853] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.452853] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.452853] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55 is going to be created. [ 578.466608] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.466792] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.466868] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.467159] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.467309] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.467453] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16baecd6-bda3-40e1-98ef-4e238a3fc354 already deleted. [ 578.467735] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16baecd6-bda3-40e1-98ef-4e238a3fc354" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.472124] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.472475] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.472644] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.473041] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.473352] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.473729] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-7f647998-9191-4369-9965-13391731c919" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.521681] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.521681] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.521681] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.521681] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.521681] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.550936] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55 in Status: UNINITIALIZED for 2s [ 578.803858] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37: rpc.has_security_group_logging(os_id): False [ 578.853386] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.853386] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.853386] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.853386] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.857029] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.857029] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.857029] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.857029] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.857029] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.857029] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.857029] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37 is going to be created. [ 578.876080] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 38b4d382-6400-4588-b620-faecfba1fd64 in Status: SUCCESS [ 578.876386] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.974014] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.974271] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.974355] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.974850] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.974850] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.997364] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37 in Status: IN_PROGRESS for 2s [ 579.589285] env[62842]: INFO networking_nsxv3.common.synchronization [req-7a36a38d-2454-4912-9539-615addf484d2 req-bb11245c-7b9c-4de9-9005-623449f30161 service nova] Enqueued Resource ID: 5704e4e3-8211-4e30-b474-06c668cf060d with Priority: HIGHEST for action security_group_rules [ 579.589285] env[62842]: INFO networking_nsxv3.common.synchronization [req-7a36a38d-2454-4912-9539-615addf484d2 req-bb11245c-7b9c-4de9-9005-623449f30161 service nova] Enqueued Resource ID: 5704e4e3-8211-4e30-b474-06c668cf060d with Priority: HIGHEST for action security_group_members [ 579.589285] env[62842]: INFO networking_nsxv3.common.synchronization [req-7a36a38d-2454-4912-9539-615addf484d2 req-bb11245c-7b9c-4de9-9005-623449f30161 service nova] Enqueued Resource ID: 7f647998-9191-4369-9965-13391731c919 with Priority: HIGHEST for action port [ 579.593807] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5704e4e3-8211-4e30-b474-06c668cf060d with Priority: HIGHEST for action security_group_rules [ 579.593807] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5704e4e3-8211-4e30-b474-06c668cf060d with Priority: HIGHEST for action security_group_members [ 579.593807] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f647998-9191-4369-9965-13391731c919 with Priority: HIGHEST for action port [ 579.593807] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5704e4e3-8211-4e30-b474-06c668cf060d taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.593807] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.593807] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.593807] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.593807] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5704e4e3-8211-4e30-b474-06c668cf060d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.595122] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5704e4e3-8211-4e30-b474-06c668cf060d taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.595122] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.595122] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.595122] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.595351] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.595351] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.595351] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.595503] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.595652] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.595756] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5704e4e3-8211-4e30-b474-06c668cf060d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.596714] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f647998-9191-4369-9965-13391731c919 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.596850] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f647998-9191-4369-9965-13391731c919" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.596919] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f647998-9191-4369-9965-13391731c919" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.597107] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f647998-9191-4369-9965-13391731c919" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.598096] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f647998-9191-4369-9965-13391731c919',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.889237] env[62842]: INFO networking_nsxv3.common.synchronization [None req-c7f26fa9-ed03-40e2-a6f8-c74eb6deb09d None None] Enqueued Resource ID: cffa2e64-ee78-407d-9276-10a9e4ac4fb2 with Priority: HIGHEST for action port [ 579.889237] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cffa2e64-ee78-407d-9276-10a9e4ac4fb2 with Priority: HIGHEST for action port [ 579.889819] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-cffa2e64-ee78-407d-9276-10a9e4ac4fb2 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.889887] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cffa2e64-ee78-407d-9276-10a9e4ac4fb2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.889957] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cffa2e64-ee78-407d-9276-10a9e4ac4fb2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.890529] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cffa2e64-ee78-407d-9276-10a9e4ac4fb2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.890623] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cffa2e64-ee78-407d-9276-10a9e4ac4fb2',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.101320] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5704e4e3-8211-4e30-b474-06c668cf060d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.101647] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5704e4e3-8211-4e30-b474-06c668cf060d taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.101800] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.102191] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7f647998-9191-4369-9965-13391731c919 with status ACTIVE [ 580.104320] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.104320] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.104320] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.104320] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.104320] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.104320] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.104320] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.104320] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.104320] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.104320] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.104320] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.104320] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.104320] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.104320] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.104320] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.105282] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7f647998-9191-4369-9965-13391731c919 is going to be updated. [ 580.130218] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.130382] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.130527] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.130786] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.130925] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.131502] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f647998-9191-4369-9965-13391731c919" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.393033] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cffa2e64-ee78-407d-9276-10a9e4ac4fb2 [ 580.393276] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.393412] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.393481] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.393696] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.393790] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.393888] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cffa2e64-ee78-407d-9276-10a9e4ac4fb2 already deleted. [ 580.393969] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cffa2e64-ee78-407d-9276-10a9e4ac4fb2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.558814] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55 in Status: SUCCESS [ 580.559094] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.559270] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.559513] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.559698] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.559819] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.559882] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.560073] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.560131] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.560211] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.560303] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.603097] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5704e4e3-8211-4e30-b474-06c668cf060d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.017423] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37 in Status: SUCCESS [ 581.017632] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.064296] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.105376] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.105641] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.105791] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.106157] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.106279] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.109022] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5704e4e3-8211-4e30-b474-06c668cf060d is going to be created. [ 581.132543] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.132678] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.132748] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.133397] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.133397] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.143767] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5704e4e3-8211-4e30-b474-06c668cf060d in Status: UNINITIALIZED for 2s [ 581.570728] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55: rpc.has_security_group_logging(os_id): False [ 581.593178] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.593560] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.593757] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.594089] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.596077] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.596077] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.596077] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.596077] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.596077] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.596077] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.596077] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55 is going to be created. [ 581.660127] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.660448] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.660448] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.660649] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.660740] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.675361] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55 in Status: IN_PROGRESS for 2s [ 582.058290] env[62842]: INFO networking_nsxv3.common.synchronization [req-3f3821a9-8d04-46dd-ac5c-6cd686c994da req-89fc70e1-faad-4f65-abdb-25af10c614a6 tempest-SecurityGroupRulesNegativeTestJSON-257197119 tempest-SecurityGroupRulesNegativeTestJSON-257197119-project-member] Enqueued Resource ID: 06f675f9-aeae-45b5-b76b-1b6124126cdd with Priority: HIGHEST for action security_group_rules [ 582.058982] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06f675f9-aeae-45b5-b76b-1b6124126cdd with Priority: HIGHEST for action security_group_rules [ 582.059278] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06f675f9-aeae-45b5-b76b-1b6124126cdd taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.059406] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06f675f9-aeae-45b5-b76b-1b6124126cdd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.059475] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06f675f9-aeae-45b5-b76b-1b6124126cdd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.060214] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06f675f9-aeae-45b5-b76b-1b6124126cdd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.060214] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06f675f9-aeae-45b5-b76b-1b6124126cdd',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.255827] env[62842]: INFO networking_nsxv3.common.synchronization [req-c7ef2435-f4e9-4bde-b998-5053117aa5e2 req-c30ec904-3b60-48c1-90e5-4df78a8b6e26 tempest-ServerExternalEventsTest-541493461 tempest-ServerExternalEventsTest-541493461-project-member] Enqueued Resource ID: b132ea78-a4b4-47a2-98dc-0d195c085bca with Priority: HIGHEST for action security_group_members [ 582.256387] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b132ea78-a4b4-47a2-98dc-0d195c085bca with Priority: HIGHEST for action security_group_members [ 582.256821] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-b132ea78-a4b4-47a2-98dc-0d195c085bca taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.256990] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b132ea78-a4b4-47a2-98dc-0d195c085bca" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.257133] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b132ea78-a4b4-47a2-98dc-0d195c085bca" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.258328] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b132ea78-a4b4-47a2-98dc-0d195c085bca" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.258328] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.258328] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.258328] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.258328] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.258328] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.258328] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b132ea78-a4b4-47a2-98dc-0d195c085bca',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.266236] env[62842]: INFO networking_nsxv3.common.synchronization [None req-212ea181-39f6-4911-a78d-1b89f46f877e None None] Enqueued Resource ID: ed620d86-236a-438e-acc0-c49c78873e34 with Priority: HIGHEST for action port [ 582.266834] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed620d86-236a-438e-acc0-c49c78873e34 with Priority: HIGHEST for action port [ 582.267874] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed620d86-236a-438e-acc0-c49c78873e34 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.268019] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed620d86-236a-438e-acc0-c49c78873e34" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.268396] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed620d86-236a-438e-acc0-c49c78873e34" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.268469] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed620d86-236a-438e-acc0-c49c78873e34" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.268598] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed620d86-236a-438e-acc0-c49c78873e34',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.589291] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.589534] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.589534] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.589810] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.589810] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.589908] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06f675f9-aeae-45b5-b76b-1b6124126cdd already deleted. [ 582.590093] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06f675f9-aeae-45b5-b76b-1b6124126cdd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.762294] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.762741] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.762741] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.762901] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.763077] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.763274] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.763390] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.763445] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.763628] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.763712] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.763810] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b132ea78-a4b4-47a2-98dc-0d195c085bca is going to be updated. [ 582.774486] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ed620d86-236a-438e-acc0-c49c78873e34 [ 582.774908] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.774997] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.774997] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.775235] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.775333] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.775423] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ed620d86-236a-438e-acc0-c49c78873e34 already deleted. [ 582.775670] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed620d86-236a-438e-acc0-c49c78873e34" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.801942] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.802210] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.802210] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.802395] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.802545] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.816586] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b132ea78-a4b4-47a2-98dc-0d195c085bca in Status: IN_PROGRESS for 2s [ 583.158778] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5704e4e3-8211-4e30-b474-06c668cf060d in Status: SUCCESS [ 583.158778] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.158778] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.158778] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.158778] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.158778] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.158778] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.158778] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.158778] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.158778] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.158778] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5704e4e3-8211-4e30-b474-06c668cf060d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.532959] env[62842]: INFO networking_nsxv3.common.synchronization [None req-f23732a2-30e3-405b-8edb-c7be7d86283a None None] Enqueued Resource ID: 2303f8f6-66e5-4c7b-9ea2-74bd8cfcd62e with Priority: HIGHEST for action port [ 583.532959] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2303f8f6-66e5-4c7b-9ea2-74bd8cfcd62e with Priority: HIGHEST for action port [ 583.533353] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-2303f8f6-66e5-4c7b-9ea2-74bd8cfcd62e taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.533514] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2303f8f6-66e5-4c7b-9ea2-74bd8cfcd62e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.537170] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2303f8f6-66e5-4c7b-9ea2-74bd8cfcd62e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.537503] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2303f8f6-66e5-4c7b-9ea2-74bd8cfcd62e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.537601] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2303f8f6-66e5-4c7b-9ea2-74bd8cfcd62e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.661487] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5704e4e3-8211-4e30-b474-06c668cf060d taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.661723] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.661807] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.662069] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.662267] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.662406] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.662474] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.662655] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.662749] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.662863] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.663041] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5704e4e3-8211-4e30-b474-06c668cf060d taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.663166] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.663230] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.663411] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.663553] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.663666] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.663730] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.663879] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.663989] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.664090] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.664184] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5704e4e3-8211-4e30-b474-06c668cf060d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.701199] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55 in Status: SUCCESS [ 583.701199] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.039972] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2303f8f6-66e5-4c7b-9ea2-74bd8cfcd62e [ 584.040310] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.040394] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.040457] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.040668] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.040762] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.040859] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2303f8f6-66e5-4c7b-9ea2-74bd8cfcd62e already deleted. [ 584.040928] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2303f8f6-66e5-4c7b-9ea2-74bd8cfcd62e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.166424] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5704e4e3-8211-4e30-b474-06c668cf060d: rpc.has_security_group_logging(os_id): False [ 584.189287] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.189287] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.189287] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.189287] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.189287] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.189287] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.189602] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.189602] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.189602] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.189602] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.189801] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.189852] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.189927] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.190075] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.190260] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.190314] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.190473] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.190473] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.190585] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.190654] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.190734] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5704e4e3-8211-4e30-b474-06c668cf060d is going to be created. [ 584.256012] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.256012] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.256012] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.256012] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.256012] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.268386] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5704e4e3-8211-4e30-b474-06c668cf060d in Status: IN_PROGRESS for 2s [ 584.608729] env[62842]: INFO networking_nsxv3.common.synchronization [req-fafc6c50-0dc0-4bca-ad71-f01b83031947 req-1a55f9f3-6ead-436f-85f2-73300661c959 tempest-SecurityGroupRulesNegativeTestJSON-257197119 tempest-SecurityGroupRulesNegativeTestJSON-257197119-project-member] Enqueued Resource ID: 06f675f9-aeae-45b5-b76b-1b6124126cdd with Priority: HIGHEST for action security_group_rules [ 584.610403] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06f675f9-aeae-45b5-b76b-1b6124126cdd with Priority: HIGHEST for action security_group_rules [ 584.610403] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06f675f9-aeae-45b5-b76b-1b6124126cdd taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.610403] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06f675f9-aeae-45b5-b76b-1b6124126cdd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.610403] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06f675f9-aeae-45b5-b76b-1b6124126cdd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.612356] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06f675f9-aeae-45b5-b76b-1b6124126cdd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.612458] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06f675f9-aeae-45b5-b76b-1b6124126cdd',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.731022] env[62842]: INFO networking_nsxv3.common.synchronization [None req-0c1ea7c0-7527-4d66-90cd-b63f4ed40d2d tempest-AttachVolumeNegativeTest-1420230652 tempest-AttachVolumeNegativeTest-1420230652-project-member] Enqueued Resource ID: c0ccbbde-9e94-45de-b00c-8f135b84465d with Priority: HIGHEST for action security_group_rules [ 584.731022] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0ccbbde-9e94-45de-b00c-8f135b84465d with Priority: HIGHEST for action security_group_rules [ 584.731590] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0ccbbde-9e94-45de-b00c-8f135b84465d taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.732255] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0ccbbde-9e94-45de-b00c-8f135b84465d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.732468] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0ccbbde-9e94-45de-b00c-8f135b84465d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.732817] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0ccbbde-9e94-45de-b00c-8f135b84465d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.734418] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0ccbbde-9e94-45de-b00c-8f135b84465d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.829611] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b132ea78-a4b4-47a2-98dc-0d195c085bca in Status: SUCCESS [ 584.829804] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b132ea78-a4b4-47a2-98dc-0d195c085bca deletion is rescheduled due to dependency. [ 584.829945] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b132ea78-a4b4-47a2-98dc-0d195c085bca" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.861600] env[62842]: INFO networking_nsxv3.common.synchronization [None req-8705eaf7-3369-4174-aff7-f76335be30ca None None] Enqueued Resource ID: 77423ba5-b8c1-4058-8d64-342df012fe63 with Priority: HIGHEST for action port [ 584.861876] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77423ba5-b8c1-4058-8d64-342df012fe63 with Priority: HIGHEST for action port [ 584.862535] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-77423ba5-b8c1-4058-8d64-342df012fe63 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.862665] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77423ba5-b8c1-4058-8d64-342df012fe63" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.862718] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77423ba5-b8c1-4058-8d64-342df012fe63" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.863325] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77423ba5-b8c1-4058-8d64-342df012fe63" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.864997] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77423ba5-b8c1-4058-8d64-342df012fe63',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.870973] env[62842]: INFO networking_nsxv3.common.synchronization [None req-283cf9b7-636e-4571-9970-84a7e65efcc2 tempest-AttachVolumeNegativeTest-1420230652 tempest-AttachVolumeNegativeTest-1420230652-project-member] Enqueued Resource ID: c0ccbbde-9e94-45de-b00c-8f135b84465d with Priority: HIGHEST for action security_group_rules [ 584.870973] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0ccbbde-9e94-45de-b00c-8f135b84465d with Priority: HIGHEST for action security_group_rules [ 584.870973] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0ccbbde-9e94-45de-b00c-8f135b84465d taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.870973] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0ccbbde-9e94-45de-b00c-8f135b84465d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.137027] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.137027] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.137027] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.137027] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.137027] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.137027] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06f675f9-aeae-45b5-b76b-1b6124126cdd already deleted. [ 585.137027] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06f675f9-aeae-45b5-b76b-1b6124126cdd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.258883] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.259076] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.259141] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.259318] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.259410] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.259518] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0ccbbde-9e94-45de-b00c-8f135b84465d already deleted. [ 585.259673] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0ccbbde-9e94-45de-b00c-8f135b84465d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.259807] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0ccbbde-9e94-45de-b00c-8f135b84465d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.259902] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0ccbbde-9e94-45de-b00c-8f135b84465d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.259982] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0ccbbde-9e94-45de-b00c-8f135b84465d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.368170] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 77423ba5-b8c1-4058-8d64-342df012fe63 [ 585.368652] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.369445] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.369445] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.369675] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.369789] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.369917] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:77423ba5-b8c1-4058-8d64-342df012fe63 already deleted. [ 585.370023] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77423ba5-b8c1-4058-8d64-342df012fe63" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.782642] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.782792] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.782862] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.783105] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.783199] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.783299] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0ccbbde-9e94-45de-b00c-8f135b84465d already deleted. [ 585.783380] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0ccbbde-9e94-45de-b00c-8f135b84465d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.254993] env[62842]: INFO networking_nsxv3.common.synchronization [None req-985a0938-8a0d-4c1f-993d-356e424c0596 None None] Enqueued Resource ID: 6432417e-2098-496f-9974-11c4918f3d3d with Priority: HIGHEST for action port [ 586.255888] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6432417e-2098-496f-9974-11c4918f3d3d with Priority: HIGHEST for action port [ 586.256456] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-6432417e-2098-496f-9974-11c4918f3d3d taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.256665] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6432417e-2098-496f-9974-11c4918f3d3d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.257180] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6432417e-2098-496f-9974-11c4918f3d3d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.257180] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6432417e-2098-496f-9974-11c4918f3d3d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.257339] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6432417e-2098-496f-9974-11c4918f3d3d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.284712] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5704e4e3-8211-4e30-b474-06c668cf060d in Status: SUCCESS [ 586.285214] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.760440] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6432417e-2098-496f-9974-11c4918f3d3d [ 586.761341] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.761598] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.761678] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.762056] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.762056] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.762160] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6432417e-2098-496f-9974-11c4918f3d3d already deleted. [ 586.763116] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6432417e-2098-496f-9974-11c4918f3d3d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.796712] env[62842]: INFO networking_nsxv3.common.synchronization [req-78717637-4101-4172-9b20-e9b29e21858f req-4d9b04da-bef9-446c-96b4-d5d90bab3009 tempest-ImagesNegativeTestJSON-1147075728 tempest-ImagesNegativeTestJSON-1147075728-project-member] Enqueued Resource ID: 3f89b292-3278-4b67-9a1b-21e48a9ef380 with Priority: HIGHEST for action security_group_members [ 586.797644] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f89b292-3278-4b67-9a1b-21e48a9ef380 with Priority: HIGHEST for action security_group_members [ 586.797644] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f89b292-3278-4b67-9a1b-21e48a9ef380 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.797922] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f89b292-3278-4b67-9a1b-21e48a9ef380" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.797922] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f89b292-3278-4b67-9a1b-21e48a9ef380" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.798540] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f89b292-3278-4b67-9a1b-21e48a9ef380" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.798540] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.798540] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.798540] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.798768] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.798768] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.798932] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f89b292-3278-4b67-9a1b-21e48a9ef380',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.305227] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.305227] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.305227] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.305227] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.305227] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.305227] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.306357] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.306357] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.306357] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.306357] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.306357] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f89b292-3278-4b67-9a1b-21e48a9ef380 is going to be updated. [ 587.341579] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.341779] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.341924] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.343034] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.343034] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.360075] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f89b292-3278-4b67-9a1b-21e48a9ef380 in Status: IN_PROGRESS for 2s [ 588.950150] env[62842]: INFO networking_nsxv3.common.synchronization [req-3fd9a2cc-362d-4afd-88b2-86cd060599ec req-9b91df92-03c4-4737-aae9-cd89cda67823 tempest-ServerDiagnosticsTest-598226030 tempest-ServerDiagnosticsTest-598226030-project-member] Enqueued Resource ID: 473d98b1-ea12-43f6-8749-401a513b928c with Priority: HIGHEST for action security_group_members [ 588.951612] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 473d98b1-ea12-43f6-8749-401a513b928c with Priority: HIGHEST for action security_group_members [ 588.952935] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-473d98b1-ea12-43f6-8749-401a513b928c taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.952935] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-473d98b1-ea12-43f6-8749-401a513b928c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.952935] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-473d98b1-ea12-43f6-8749-401a513b928c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.952935] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-473d98b1-ea12-43f6-8749-401a513b928c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.952935] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.952935] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.952935] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.952935] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.953971] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.953971] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('473d98b1-ea12-43f6-8749-401a513b928c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.372242] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f89b292-3278-4b67-9a1b-21e48a9ef380 in Status: SUCCESS [ 589.372433] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f89b292-3278-4b67-9a1b-21e48a9ef380 deletion is rescheduled due to dependency. [ 589.372550] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f89b292-3278-4b67-9a1b-21e48a9ef380" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.457585] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.457969] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.457969] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.458214] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.458381] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.458571] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.458691] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.458983] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.458983] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.459080] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.459111] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 473d98b1-ea12-43f6-8749-401a513b928c is going to be updated. [ 589.490496] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.490667] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.490730] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.491102] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.491102] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.503014] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 473d98b1-ea12-43f6-8749-401a513b928c in Status: IN_PROGRESS for 2s [ 590.139188] env[62842]: INFO networking_nsxv3.common.synchronization [req-f8503893-1f95-4669-aa78-e7043f42af55 req-a2222d8a-4965-47b2-bbd3-13f18e912efe tempest-SecurityGroupsTestJSON-1354345429 tempest-SecurityGroupsTestJSON-1354345429-project-member] Enqueued Resource ID: 5704e4e3-8211-4e30-b474-06c668cf060d with Priority: HIGHEST for action security_group_members [ 590.139476] env[62842]: INFO networking_nsxv3.common.synchronization [req-f8503893-1f95-4669-aa78-e7043f42af55 req-a2222d8a-4965-47b2-bbd3-13f18e912efe tempest-SecurityGroupsTestJSON-1354345429 tempest-SecurityGroupsTestJSON-1354345429-project-member] Enqueued Resource ID: ccb27bcf-56d8-49d9-af51-9eb4b1211bce with Priority: HIGHEST for action security_group_members [ 590.139887] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5704e4e3-8211-4e30-b474-06c668cf060d with Priority: HIGHEST for action security_group_members [ 590.140166] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccb27bcf-56d8-49d9-af51-9eb4b1211bce with Priority: HIGHEST for action security_group_members [ 590.140376] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5704e4e3-8211-4e30-b474-06c668cf060d taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.140484] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.140542] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.141389] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.141389] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.141389] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.141389] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.141389] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.141389] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.141389] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5704e4e3-8211-4e30-b474-06c668cf060d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.142250] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccb27bcf-56d8-49d9-af51-9eb4b1211bce taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.143338] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccb27bcf-56d8-49d9-af51-9eb4b1211bce" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.143338] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccb27bcf-56d8-49d9-af51-9eb4b1211bce" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.143453] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccb27bcf-56d8-49d9-af51-9eb4b1211bce" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.144141] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.144141] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.144141] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.144141] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.144141] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.144141] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ccb27bcf-56d8-49d9-af51-9eb4b1211bce',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.211269] env[62842]: INFO networking_nsxv3.common.synchronization [req-f8503893-1f95-4669-aa78-e7043f42af55 req-a2222d8a-4965-47b2-bbd3-13f18e912efe tempest-SecurityGroupsTestJSON-1354345429 tempest-SecurityGroupsTestJSON-1354345429-project-member] Enqueued Resource ID: 5704e4e3-8211-4e30-b474-06c668cf060d with Priority: HIGHEST for action security_group_rules [ 590.211466] env[62842]: INFO networking_nsxv3.common.synchronization [req-f8503893-1f95-4669-aa78-e7043f42af55 req-a2222d8a-4965-47b2-bbd3-13f18e912efe tempest-SecurityGroupsTestJSON-1354345429 tempest-SecurityGroupsTestJSON-1354345429-project-member] Enqueued Resource ID: 5704e4e3-8211-4e30-b474-06c668cf060d with Priority: HIGHEST for action security_group_members [ 590.211597] env[62842]: INFO networking_nsxv3.common.synchronization [req-f8503893-1f95-4669-aa78-e7043f42af55 req-a2222d8a-4965-47b2-bbd3-13f18e912efe tempest-SecurityGroupsTestJSON-1354345429 tempest-SecurityGroupsTestJSON-1354345429-project-member] Enqueued Resource ID: ccb27bcf-56d8-49d9-af51-9eb4b1211bce with Priority: HIGHEST for action security_group_rules [ 590.211731] env[62842]: INFO networking_nsxv3.common.synchronization [req-f8503893-1f95-4669-aa78-e7043f42af55 req-a2222d8a-4965-47b2-bbd3-13f18e912efe tempest-SecurityGroupsTestJSON-1354345429 tempest-SecurityGroupsTestJSON-1354345429-project-member] Enqueued Resource ID: ccb27bcf-56d8-49d9-af51-9eb4b1211bce with Priority: HIGHEST for action security_group_members [ 590.211857] env[62842]: INFO networking_nsxv3.common.synchronization [req-f8503893-1f95-4669-aa78-e7043f42af55 req-a2222d8a-4965-47b2-bbd3-13f18e912efe tempest-SecurityGroupsTestJSON-1354345429 tempest-SecurityGroupsTestJSON-1354345429-project-member] Enqueued Resource ID: 7f647998-9191-4369-9965-13391731c919 with Priority: HIGHEST for action port [ 590.212835] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5704e4e3-8211-4e30-b474-06c668cf060d with Priority: HIGHEST for action security_group_rules [ 590.213096] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccb27bcf-56d8-49d9-af51-9eb4b1211bce with Priority: HIGHEST for action security_group_rules [ 590.213254] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f647998-9191-4369-9965-13391731c919 with Priority: HIGHEST for action port [ 590.213419] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5704e4e3-8211-4e30-b474-06c668cf060d with Priority: HIGHEST for action security_group_members [ 590.213550] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccb27bcf-56d8-49d9-af51-9eb4b1211bce with Priority: HIGHEST for action security_group_members [ 590.213902] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5704e4e3-8211-4e30-b474-06c668cf060d taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.214073] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.214183] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.214948] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.214948] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5704e4e3-8211-4e30-b474-06c668cf060d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.216326] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ccb27bcf-56d8-49d9-af51-9eb4b1211bce taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.216711] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ccb27bcf-56d8-49d9-af51-9eb4b1211bce" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.217509] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ccb27bcf-56d8-49d9-af51-9eb4b1211bce" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.221085] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ccb27bcf-56d8-49d9-af51-9eb4b1211bce" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.221085] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ccb27bcf-56d8-49d9-af51-9eb4b1211bce',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.221085] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f647998-9191-4369-9965-13391731c919 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.221085] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f647998-9191-4369-9965-13391731c919" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.221085] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f647998-9191-4369-9965-13391731c919" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.221085] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f647998-9191-4369-9965-13391731c919" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.221085] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f647998-9191-4369-9965-13391731c919',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.221085] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5704e4e3-8211-4e30-b474-06c668cf060d taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.221085] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.221085] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccb27bcf-56d8-49d9-af51-9eb4b1211bce taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.221085] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccb27bcf-56d8-49d9-af51-9eb4b1211bce" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.647395] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5704e4e3-8211-4e30-b474-06c668cf060d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.647395] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ccb27bcf-56d8-49d9-af51-9eb4b1211bce',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.723604] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5704e4e3-8211-4e30-b474-06c668cf060d taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.723956] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.725412] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7f647998-9191-4369-9965-13391731c919 with status ACTIVE [ 590.725858] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.726060] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.726148] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.726415] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.726649] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.726757] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.726904] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.727025] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.727246] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.727354] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.727615] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.727780] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.727843] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.727991] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.728076] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.728166] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7f647998-9191-4369-9965-13391731c919 is going to be updated. [ 590.729512] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccb27bcf-56d8-49d9-af51-9eb4b1211bce taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.729695] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccb27bcf-56d8-49d9-af51-9eb4b1211bce" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.751160] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.751376] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.752502] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.752502] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.752502] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.752502] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f647998-9191-4369-9965-13391731c919" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.148196] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5704e4e3-8211-4e30-b474-06c668cf060d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.152069] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ccb27bcf-56d8-49d9-af51-9eb4b1211bce',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.516375] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 473d98b1-ea12-43f6-8749-401a513b928c in Status: SUCCESS [ 591.516602] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 473d98b1-ea12-43f6-8749-401a513b928c deletion is rescheduled due to dependency. [ 591.516833] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-473d98b1-ea12-43f6-8749-401a513b928c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.520140] env[62842]: INFO networking_nsxv3.common.synchronization [req-e09e2dc6-234b-4252-9efd-a560bf39171d req-b40d1da2-2683-4686-a902-34a4a9fbf38e tempest-SecurityGroupsTestJSON-1354345429 tempest-SecurityGroupsTestJSON-1354345429-project-member] Enqueued Resource ID: 1648554a-7f11-49bf-b9b2-6edf888e2ce9 with Priority: HIGHEST for action security_group_members [ 591.520354] env[62842]: INFO networking_nsxv3.common.synchronization [req-e09e2dc6-234b-4252-9efd-a560bf39171d req-b40d1da2-2683-4686-a902-34a4a9fbf38e tempest-SecurityGroupsTestJSON-1354345429 tempest-SecurityGroupsTestJSON-1354345429-project-member] Enqueued Resource ID: 5704e4e3-8211-4e30-b474-06c668cf060d with Priority: HIGHEST for action security_group_members [ 591.520506] env[62842]: INFO networking_nsxv3.common.synchronization [req-e09e2dc6-234b-4252-9efd-a560bf39171d req-b40d1da2-2683-4686-a902-34a4a9fbf38e tempest-SecurityGroupsTestJSON-1354345429 tempest-SecurityGroupsTestJSON-1354345429-project-member] Enqueued Resource ID: ccb27bcf-56d8-49d9-af51-9eb4b1211bce with Priority: HIGHEST for action security_group_members [ 591.521087] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1648554a-7f11-49bf-b9b2-6edf888e2ce9 with Priority: HIGHEST for action security_group_members [ 591.522255] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5704e4e3-8211-4e30-b474-06c668cf060d with Priority: HIGHEST for action security_group_members [ 591.522393] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccb27bcf-56d8-49d9-af51-9eb4b1211bce with Priority: HIGHEST for action security_group_members [ 591.522728] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-1648554a-7f11-49bf-b9b2-6edf888e2ce9 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.522867] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1648554a-7f11-49bf-b9b2-6edf888e2ce9" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.522867] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1648554a-7f11-49bf-b9b2-6edf888e2ce9" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.523145] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1648554a-7f11-49bf-b9b2-6edf888e2ce9" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.524527] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.524841] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.524927] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.525133] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.525230] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.525334] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1648554a-7f11-49bf-b9b2-6edf888e2ce9',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.526413] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5704e4e3-8211-4e30-b474-06c668cf060d taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.526512] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.527175] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccb27bcf-56d8-49d9-af51-9eb4b1211bce taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.527226] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccb27bcf-56d8-49d9-af51-9eb4b1211bce" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.641720] env[62842]: INFO networking_nsxv3.common.synchronization [req-e09e2dc6-234b-4252-9efd-a560bf39171d req-b40d1da2-2683-4686-a902-34a4a9fbf38e tempest-SecurityGroupsTestJSON-1354345429 tempest-SecurityGroupsTestJSON-1354345429-project-member] Enqueued Resource ID: 1648554a-7f11-49bf-b9b2-6edf888e2ce9 with Priority: HIGHEST for action security_group_rules [ 591.641966] env[62842]: INFO networking_nsxv3.common.synchronization [req-e09e2dc6-234b-4252-9efd-a560bf39171d req-b40d1da2-2683-4686-a902-34a4a9fbf38e tempest-SecurityGroupsTestJSON-1354345429 tempest-SecurityGroupsTestJSON-1354345429-project-member] Enqueued Resource ID: 1648554a-7f11-49bf-b9b2-6edf888e2ce9 with Priority: HIGHEST for action security_group_members [ 591.642314] env[62842]: INFO networking_nsxv3.common.synchronization [req-e09e2dc6-234b-4252-9efd-a560bf39171d req-b40d1da2-2683-4686-a902-34a4a9fbf38e tempest-SecurityGroupsTestJSON-1354345429 tempest-SecurityGroupsTestJSON-1354345429-project-member] Enqueued Resource ID: 5704e4e3-8211-4e30-b474-06c668cf060d with Priority: HIGHEST for action security_group_rules [ 591.642485] env[62842]: INFO networking_nsxv3.common.synchronization [req-e09e2dc6-234b-4252-9efd-a560bf39171d req-b40d1da2-2683-4686-a902-34a4a9fbf38e tempest-SecurityGroupsTestJSON-1354345429 tempest-SecurityGroupsTestJSON-1354345429-project-member] Enqueued Resource ID: 5704e4e3-8211-4e30-b474-06c668cf060d with Priority: HIGHEST for action security_group_members [ 591.642658] env[62842]: INFO networking_nsxv3.common.synchronization [req-e09e2dc6-234b-4252-9efd-a560bf39171d req-b40d1da2-2683-4686-a902-34a4a9fbf38e tempest-SecurityGroupsTestJSON-1354345429 tempest-SecurityGroupsTestJSON-1354345429-project-member] Enqueued Resource ID: ccb27bcf-56d8-49d9-af51-9eb4b1211bce with Priority: HIGHEST for action security_group_rules [ 591.642798] env[62842]: INFO networking_nsxv3.common.synchronization [req-e09e2dc6-234b-4252-9efd-a560bf39171d req-b40d1da2-2683-4686-a902-34a4a9fbf38e tempest-SecurityGroupsTestJSON-1354345429 tempest-SecurityGroupsTestJSON-1354345429-project-member] Enqueued Resource ID: ccb27bcf-56d8-49d9-af51-9eb4b1211bce with Priority: HIGHEST for action security_group_members [ 591.642961] env[62842]: INFO networking_nsxv3.common.synchronization [req-e09e2dc6-234b-4252-9efd-a560bf39171d req-b40d1da2-2683-4686-a902-34a4a9fbf38e tempest-SecurityGroupsTestJSON-1354345429 tempest-SecurityGroupsTestJSON-1354345429-project-member] Enqueued Resource ID: 7f647998-9191-4369-9965-13391731c919 with Priority: HIGHEST for action port [ 591.643602] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1648554a-7f11-49bf-b9b2-6edf888e2ce9 with Priority: HIGHEST for action security_group_rules [ 591.643746] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5704e4e3-8211-4e30-b474-06c668cf060d with Priority: HIGHEST for action security_group_rules [ 591.643847] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccb27bcf-56d8-49d9-af51-9eb4b1211bce with Priority: HIGHEST for action security_group_members [ 591.643972] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f647998-9191-4369-9965-13391731c919 with Priority: HIGHEST for action port [ 591.644107] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccb27bcf-56d8-49d9-af51-9eb4b1211bce with Priority: HIGHEST for action security_group_rules [ 591.644203] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1648554a-7f11-49bf-b9b2-6edf888e2ce9 with Priority: HIGHEST for action security_group_members [ 591.644300] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5704e4e3-8211-4e30-b474-06c668cf060d with Priority: HIGHEST for action security_group_members [ 591.644673] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1648554a-7f11-49bf-b9b2-6edf888e2ce9 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.644817] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1648554a-7f11-49bf-b9b2-6edf888e2ce9" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.644890] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1648554a-7f11-49bf-b9b2-6edf888e2ce9" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.645224] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1648554a-7f11-49bf-b9b2-6edf888e2ce9" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.645350] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1648554a-7f11-49bf-b9b2-6edf888e2ce9',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.651028] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5704e4e3-8211-4e30-b474-06c668cf060d taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.651028] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.651028] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccb27bcf-56d8-49d9-af51-9eb4b1211bce taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.651028] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccb27bcf-56d8-49d9-af51-9eb4b1211bce" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.651028] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f647998-9191-4369-9965-13391731c919 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.651028] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f647998-9191-4369-9965-13391731c919" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.651028] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f647998-9191-4369-9965-13391731c919" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.651028] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f647998-9191-4369-9965-13391731c919" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.651028] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f647998-9191-4369-9965-13391731c919',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.651028] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ccb27bcf-56d8-49d9-af51-9eb4b1211bce taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.651028] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ccb27bcf-56d8-49d9-af51-9eb4b1211bce" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.651028] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-1648554a-7f11-49bf-b9b2-6edf888e2ce9 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.651028] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1648554a-7f11-49bf-b9b2-6edf888e2ce9" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.651028] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5704e4e3-8211-4e30-b474-06c668cf060d taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.651816] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.652169] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.652305] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.652348] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.652567] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.652688] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.652767] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5704e4e3-8211-4e30-b474-06c668cf060d is going to be updated. [ 591.661170] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.661345] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.661410] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.662308] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.662308] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.662308] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ccb27bcf-56d8-49d9-af51-9eb4b1211bce is going to be created. [ 591.685532] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.686520] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.686520] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.686520] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.686520] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.699707] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5704e4e3-8211-4e30-b474-06c668cf060d in Status: IN_PROGRESS for 2s [ 591.700626] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.700808] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.700867] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.701264] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.701767] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.713105] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccb27bcf-56d8-49d9-af51-9eb4b1211bce in Status: UNINITIALIZED for 2s [ 592.028755] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1648554a-7f11-49bf-b9b2-6edf888e2ce9',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.152129] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7f647998-9191-4369-9965-13391731c919 with status ACTIVE [ 592.152382] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.152485] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.152518] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.153415] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.153415] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.153415] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.153415] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.153415] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.153415] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.153415] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.153726] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.153726] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.153726] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.153842] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.153880] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.155996] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7f647998-9191-4369-9965-13391731c919 is going to be updated. [ 592.155996] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-1648554a-7f11-49bf-b9b2-6edf888e2ce9 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.155996] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1648554a-7f11-49bf-b9b2-6edf888e2ce9" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.179688] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.183682] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.183682] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.183682] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.183834] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.183939] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f647998-9191-4369-9965-13391731c919" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.531210] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1648554a-7f11-49bf-b9b2-6edf888e2ce9',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.746435] env[62842]: INFO networking_nsxv3.common.synchronization [None req-89c84358-75c0-4c6d-a375-b69e0004a99c None None] Enqueued Resource ID: f166b211-6a1a-43d6-9899-4fe378c602e8 with Priority: HIGHEST for action port [ 592.746707] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f166b211-6a1a-43d6-9899-4fe378c602e8 with Priority: HIGHEST for action port [ 592.747512] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-f166b211-6a1a-43d6-9899-4fe378c602e8 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.747629] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f166b211-6a1a-43d6-9899-4fe378c602e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.747629] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f166b211-6a1a-43d6-9899-4fe378c602e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.748496] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f166b211-6a1a-43d6-9899-4fe378c602e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.748496] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f166b211-6a1a-43d6-9899-4fe378c602e8',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.785139] env[62842]: INFO networking_nsxv3.common.synchronization [None req-3e8bf7f3-3f66-4a47-aed0-c6c97857c55f None None] Enqueued Resource ID: ee765d7e-c710-4333-9fcc-981295edd241 with Priority: HIGHEST for action port [ 592.785139] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee765d7e-c710-4333-9fcc-981295edd241 with Priority: HIGHEST for action port [ 592.786070] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-ee765d7e-c710-4333-9fcc-981295edd241 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.786388] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ee765d7e-c710-4333-9fcc-981295edd241" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.786774] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ee765d7e-c710-4333-9fcc-981295edd241" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.787232] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ee765d7e-c710-4333-9fcc-981295edd241" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.787427] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee765d7e-c710-4333-9fcc-981295edd241',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.034373] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.034542] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.034595] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.034779] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.035134] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.035134] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1648554a-7f11-49bf-b9b2-6edf888e2ce9 is going to be created. [ 593.061356] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.061620] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.061702] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.061949] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.062154] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.074731] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1648554a-7f11-49bf-b9b2-6edf888e2ce9 in Status: UNINITIALIZED for 2s [ 593.249906] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f166b211-6a1a-43d6-9899-4fe378c602e8 [ 593.250207] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.250289] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.250379] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.250607] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.250657] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.250729] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f166b211-6a1a-43d6-9899-4fe378c602e8 already deleted. [ 593.250804] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f166b211-6a1a-43d6-9899-4fe378c602e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.291376] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ee765d7e-c710-4333-9fcc-981295edd241 [ 593.295987] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.295987] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.295987] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.295987] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.295987] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.295987] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ee765d7e-c710-4333-9fcc-981295edd241 already deleted. [ 593.295987] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ee765d7e-c710-4333-9fcc-981295edd241" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.721648] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5704e4e3-8211-4e30-b474-06c668cf060d in Status: IN_PROGRESS for 4s [ 593.725724] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccb27bcf-56d8-49d9-af51-9eb4b1211bce in Status: SUCCESS [ 593.725724] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccb27bcf-56d8-49d9-af51-9eb4b1211bce" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.727762] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccb27bcf-56d8-49d9-af51-9eb4b1211bce" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.728068] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccb27bcf-56d8-49d9-af51-9eb4b1211bce" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.728266] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.728905] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.728905] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.728905] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.728905] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.728905] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ccb27bcf-56d8-49d9-af51-9eb4b1211bce',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.231782] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ccb27bcf-56d8-49d9-af51-9eb4b1211bce',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.733647] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ccb27bcf-56d8-49d9-af51-9eb4b1211bce',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.923769] env[62842]: INFO networking_nsxv3.common.synchronization [req-d06262fd-dac3-4d39-b0ff-b439db3f95bc req-178a0109-0a42-42bc-8a95-a0b71af72008 tempest-ServerActionsTestJSON-670456711 tempest-ServerActionsTestJSON-670456711-project-member] Enqueued Resource ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 with Priority: HIGHEST for action security_group_members [ 594.923769] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 with Priority: HIGHEST for action security_group_members [ 594.923769] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a03224f-b75b-48a5-9e23-3ca50aabbb33 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.923769] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.924028] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.924092] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.924262] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.924354] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.924412] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.924562] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.924643] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.924743] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a03224f-b75b-48a5-9e23-3ca50aabbb33',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.969372] env[62842]: INFO networking_nsxv3.common.synchronization [None req-757debba-cb50-4b7a-bbe4-39f44f5b7bf4 None None] Enqueued Resource ID: 0832ca4d-1cbe-4771-aa1b-a7fa18c0c2f0 with Priority: HIGHEST for action port [ 594.969372] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0832ca4d-1cbe-4771-aa1b-a7fa18c0c2f0 with Priority: HIGHEST for action port [ 594.969796] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-0832ca4d-1cbe-4771-aa1b-a7fa18c0c2f0 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.969925] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0832ca4d-1cbe-4771-aa1b-a7fa18c0c2f0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.969992] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0832ca4d-1cbe-4771-aa1b-a7fa18c0c2f0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.970576] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0832ca4d-1cbe-4771-aa1b-a7fa18c0c2f0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.970704] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0832ca4d-1cbe-4771-aa1b-a7fa18c0c2f0',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.085673] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1648554a-7f11-49bf-b9b2-6edf888e2ce9 in Status: SUCCESS [ 595.089010] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1648554a-7f11-49bf-b9b2-6edf888e2ce9" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.089010] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1648554a-7f11-49bf-b9b2-6edf888e2ce9" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.089010] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1648554a-7f11-49bf-b9b2-6edf888e2ce9" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.089010] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.089010] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.089010] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.089010] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.089010] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.089010] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1648554a-7f11-49bf-b9b2-6edf888e2ce9',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.237330] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.237702] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.237911] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.238146] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.238235] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.238337] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ccb27bcf-56d8-49d9-af51-9eb4b1211bce is going to be updated. [ 595.271671] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.271671] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.271671] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.271671] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.271671] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.281231] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccb27bcf-56d8-49d9-af51-9eb4b1211bce in Status: IN_PROGRESS for 2s [ 595.311714] env[62842]: INFO networking_nsxv3.common.synchronization [None req-90c6c66a-a49a-4768-925f-0aaf096652c2 None None] Enqueued Resource ID: 6763f156-06b8-436a-9873-d414ab72f15c with Priority: HIGHEST for action port [ 595.312171] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6763f156-06b8-436a-9873-d414ab72f15c with Priority: HIGHEST for action port [ 595.312329] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-6763f156-06b8-436a-9873-d414ab72f15c taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.312521] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6763f156-06b8-436a-9873-d414ab72f15c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.312590] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6763f156-06b8-436a-9873-d414ab72f15c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.312864] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6763f156-06b8-436a-9873-d414ab72f15c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.312944] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6763f156-06b8-436a-9873-d414ab72f15c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.383439] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-830 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.383439] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-830" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.383439] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-830" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.383439] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-830" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.384184] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.386753] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.386753] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.386753] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.386753] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.386753] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 595.386753] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 595.386753] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 595.386753] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 595.386753] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 595.386753] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 595.386753] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 595.406133] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 595.406341] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 595.406529] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 595.406719] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-830" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.407119] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-420c0db7-e282-44af-a3db-c72dd035e41d taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.407320] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-420c0db7-e282-44af-a3db-c72dd035e41d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.407445] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-420c0db7-e282-44af-a3db-c72dd035e41d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.407869] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-420c0db7-e282-44af-a3db-c72dd035e41d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.408071] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('420c0db7-e282-44af-a3db-c72dd035e41d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.427293] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.427559] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.427559] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.427839] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.427978] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.428175] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.428275] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.428338] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.428497] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.428575] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.428675] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 already deleted. [ 595.428758] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.475062] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0832ca4d-1cbe-4771-aa1b-a7fa18c0c2f0 [ 595.476525] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.476743] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.476863] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.477052] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.477150] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.477261] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0832ca4d-1cbe-4771-aa1b-a7fa18c0c2f0 already deleted. [ 595.477346] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0832ca4d-1cbe-4771-aa1b-a7fa18c0c2f0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.591370] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1648554a-7f11-49bf-b9b2-6edf888e2ce9',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.749757] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5704e4e3-8211-4e30-b474-06c668cf060d in Status: SUCCESS [ 595.750484] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.754208] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.754208] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.754208] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.754208] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.754208] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.754208] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.754208] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.758417] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5704e4e3-8211-4e30-b474-06c668cf060d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.815118] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6763f156-06b8-436a-9873-d414ab72f15c [ 595.816192] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.816192] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.816192] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.816192] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.816192] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.816192] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6763f156-06b8-436a-9873-d414ab72f15c already deleted. [ 595.816510] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6763f156-06b8-436a-9873-d414ab72f15c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.910647] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.910903] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.911135] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.911345] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.911461] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.911634] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 420c0db7-e282-44af-a3db-c72dd035e41d not found, creating... [ 595.914155] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.914304] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.914304] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.914749] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.915978] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.916532] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.916532] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.916958] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.917270] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.917425] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.917645] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 420c0db7-e282-44af-a3db-c72dd035e41d is going to be created. [ 595.920569] env[62842]: INFO networking_nsxv3.common.synchronization [None req-2d8623f8-d874-49b1-8382-aa658b3a3e7a None None] Enqueued Resource ID: 7f1f705c-776b-4bce-8e10-be6ea72e352c with Priority: HIGHEST for action port [ 595.921533] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f1f705c-776b-4bce-8e10-be6ea72e352c with Priority: HIGHEST for action port [ 595.921827] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f1f705c-776b-4bce-8e10-be6ea72e352c taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.921987] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f1f705c-776b-4bce-8e10-be6ea72e352c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.922054] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f1f705c-776b-4bce-8e10-be6ea72e352c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.922285] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f1f705c-776b-4bce-8e10-be6ea72e352c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.922426] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f1f705c-776b-4bce-8e10-be6ea72e352c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.941800] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.944095] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.944095] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.944095] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.944095] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.944095] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-420c0db7-e282-44af-a3db-c72dd035e41d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.098527] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1648554a-7f11-49bf-b9b2-6edf888e2ce9',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.262964] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5704e4e3-8211-4e30-b474-06c668cf060d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.426426] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7f1f705c-776b-4bce-8e10-be6ea72e352c [ 596.426689] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.427318] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.427318] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.427318] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.427318] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.427318] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7f1f705c-776b-4bce-8e10-be6ea72e352c already deleted. [ 596.427518] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f1f705c-776b-4bce-8e10-be6ea72e352c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.603301] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.603301] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.603301] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.603301] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.603692] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.603692] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1648554a-7f11-49bf-b9b2-6edf888e2ce9 is going to be updated. [ 596.636080] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.636242] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.636327] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.636537] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.636689] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.647156] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1648554a-7f11-49bf-b9b2-6edf888e2ce9 in Status: IN_PROGRESS for 2s [ 596.770508] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5704e4e3-8211-4e30-b474-06c668cf060d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.277796] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.277796] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.277796] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.277796] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.277796] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.277796] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5704e4e3-8211-4e30-b474-06c668cf060d is going to be updated. [ 597.282646] env[62842]: INFO networking_nsxv3.common.synchronization [req-d06262fd-dac3-4d39-b0ff-b439db3f95bc req-8bedce11-72df-4054-9e6d-500af8cf9abe service nova] Enqueued Resource ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 with Priority: HIGHEST for action security_group_rules [ 597.282646] env[62842]: INFO networking_nsxv3.common.synchronization [req-d06262fd-dac3-4d39-b0ff-b439db3f95bc req-8bedce11-72df-4054-9e6d-500af8cf9abe service nova] Enqueued Resource ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 with Priority: HIGHEST for action security_group_members [ 597.282646] env[62842]: INFO networking_nsxv3.common.synchronization [req-d06262fd-dac3-4d39-b0ff-b439db3f95bc req-8bedce11-72df-4054-9e6d-500af8cf9abe service nova] Enqueued Resource ID: 420c0db7-e282-44af-a3db-c72dd035e41d with Priority: HIGHEST for action port [ 597.282646] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 with Priority: HIGHEST for action security_group_rules [ 597.282646] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 with Priority: HIGHEST for action security_group_members [ 597.282646] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 420c0db7-e282-44af-a3db-c72dd035e41d with Priority: HIGHEST for action port [ 597.284377] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a03224f-b75b-48a5-9e23-3ca50aabbb33 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.284757] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.284883] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.285167] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.285305] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a03224f-b75b-48a5-9e23-3ca50aabbb33',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.286276] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a03224f-b75b-48a5-9e23-3ca50aabbb33 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.286470] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.286898] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.287162] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.288076] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.288076] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.288076] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.288076] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.288076] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.288076] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a03224f-b75b-48a5-9e23-3ca50aabbb33',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.289031] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-420c0db7-e282-44af-a3db-c72dd035e41d taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.289189] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-420c0db7-e282-44af-a3db-c72dd035e41d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.289321] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-420c0db7-e282-44af-a3db-c72dd035e41d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.292020] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-420c0db7-e282-44af-a3db-c72dd035e41d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.292020] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('420c0db7-e282-44af-a3db-c72dd035e41d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.304039] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccb27bcf-56d8-49d9-af51-9eb4b1211bce in Status: SUCCESS [ 597.304039] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccb27bcf-56d8-49d9-af51-9eb4b1211bce" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.304039] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccb27bcf-56d8-49d9-af51-9eb4b1211bce" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.304039] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccb27bcf-56d8-49d9-af51-9eb4b1211bce" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.304039] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.304039] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.304039] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.304039] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.304365] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.304365] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccb27bcf-56d8-49d9-af51-9eb4b1211bce" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.304365] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ccb27bcf-56d8-49d9-af51-9eb4b1211bce',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.305760] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccb27bcf-56d8-49d9-af51-9eb4b1211bce" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.305978] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccb27bcf-56d8-49d9-af51-9eb4b1211bce" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.306129] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.306243] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.306582] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.306582] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.306582] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.306582] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ccb27bcf-56d8-49d9-af51-9eb4b1211bce',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.317397] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.317761] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.317761] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.320137] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.320137] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.329790] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5704e4e3-8211-4e30-b474-06c668cf060d in Status: IN_PROGRESS for 2s [ 597.400141] env[62842]: INFO networking_nsxv3.common.synchronization [req-c9533fe9-dc9e-4063-8d84-01e853365869 req-8d2041c1-cae3-4986-b065-596e17d7628a tempest-ListServerFiltersTestJSON-2112811092 tempest-ListServerFiltersTestJSON-2112811092-project-member] Enqueued Resource ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 with Priority: HIGHEST for action security_group_members [ 597.400141] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 with Priority: HIGHEST for action security_group_members [ 597.400141] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-331dd47d-e3b4-4338-b588-cd456a9aa5f7 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.400141] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.400141] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.400141] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.400141] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.400823] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.400823] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.401105] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.401285] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.402263] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('331dd47d-e3b4-4338-b588-cd456a9aa5f7',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.794240] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a03224f-b75b-48a5-9e23-3ca50aabbb33',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.794240] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a03224f-b75b-48a5-9e23-3ca50aabbb33 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.794240] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.795244] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 420c0db7-e282-44af-a3db-c72dd035e41d with status ACTIVE [ 597.795244] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.795244] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.795244] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.795485] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.795485] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.796579] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.797334] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.798084] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.798229] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.798351] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.798770] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.798770] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.798979] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.799159] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.799519] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.799519] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 420c0db7-e282-44af-a3db-c72dd035e41d is going to be updated. [ 597.808417] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ccb27bcf-56d8-49d9-af51-9eb4b1211bce',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.811933] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ccb27bcf-56d8-49d9-af51-9eb4b1211bce',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.826307] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.826410] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.826497] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.827273] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.827273] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.827273] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-420c0db7-e282-44af-a3db-c72dd035e41d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.907238] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.907238] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.907238] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.907238] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.907238] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.907238] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.907238] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.907238] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.907238] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.907238] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.907238] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 already deleted. [ 597.907238] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.247742] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-170 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.247742] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-170" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.247742] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-170" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.248045] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-170" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.249384] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.249384] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.250101] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.250307] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.250721] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.250968] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 598.251123] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 598.251707] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 598.251707] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 598.252660] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 598.252660] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 598.252660] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 598.274232] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 598.274232] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 598.274232] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 598.274232] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-170" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.274232] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-c5d6db45-dd82-4518-a5a2-a73a50a46d49 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.274965] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-c5d6db45-dd82-4518-a5a2-a73a50a46d49" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.274965] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-c5d6db45-dd82-4518-a5a2-a73a50a46d49" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.274965] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-c5d6db45-dd82-4518-a5a2-a73a50a46d49" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.274965] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5d6db45-dd82-4518-a5a2-a73a50a46d49',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.294344] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a03224f-b75b-48a5-9e23-3ca50aabbb33',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.311083] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ccb27bcf-56d8-49d9-af51-9eb4b1211bce: rpc.has_security_group_logging(os_id): False [ 598.313925] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ccb27bcf-56d8-49d9-af51-9eb4b1211bce',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.339804] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.339953] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.340038] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.340263] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.340353] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.340578] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.344043] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.344043] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.344043] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.344043] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.344043] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ccb27bcf-56d8-49d9-af51-9eb4b1211bce is going to be created. [ 598.404670] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.404772] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.404812] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.405088] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.405192] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.418473] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ccb27bcf-56d8-49d9-af51-9eb4b1211bce in Status: IN_PROGRESS for 2s [ 598.496275] env[62842]: INFO networking_nsxv3.common.synchronization [None req-630e12a0-73d4-49ea-a071-6988004627a1 None None] Enqueued Resource ID: 15733f0a-5238-4c30-a652-f2d51b500914 with Priority: HIGHEST for action port [ 598.496275] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15733f0a-5238-4c30-a652-f2d51b500914 with Priority: HIGHEST for action port [ 598.496865] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-15733f0a-5238-4c30-a652-f2d51b500914 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.496974] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-15733f0a-5238-4c30-a652-f2d51b500914" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.497393] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-15733f0a-5238-4c30-a652-f2d51b500914" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.497721] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-15733f0a-5238-4c30-a652-f2d51b500914" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.497822] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15733f0a-5238-4c30-a652-f2d51b500914',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.663242] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1648554a-7f11-49bf-b9b2-6edf888e2ce9 in Status: SUCCESS [ 598.663242] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1648554a-7f11-49bf-b9b2-6edf888e2ce9" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.663242] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1648554a-7f11-49bf-b9b2-6edf888e2ce9" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.663242] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1648554a-7f11-49bf-b9b2-6edf888e2ce9" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.663242] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.663242] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.663242] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.663242] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.663242] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.663242] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1648554a-7f11-49bf-b9b2-6edf888e2ce9" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.663242] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1648554a-7f11-49bf-b9b2-6edf888e2ce9',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.777839] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.778202] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.778376] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.778545] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.778783] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.778921] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port c5d6db45-dd82-4518-a5a2-a73a50a46d49 not found, creating... [ 598.779240] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.779418] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.779775] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.779775] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.779910] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.780198] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.780358] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.780519] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.781060] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.781060] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.784511] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: c5d6db45-dd82-4518-a5a2-a73a50a46d49 is going to be created. [ 598.797141] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.797507] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.797507] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.797583] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.799519] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.799519] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 is going to be created. [ 598.803244] env[62842]: INFO networking_nsxv3.common.synchronization [None req-1123da99-97eb-4b8b-9793-de9d71a3f78d tempest-ServersTestBootFromVolume-595571146 tempest-ServersTestBootFromVolume-595571146-project-member] Enqueued Resource ID: d1d35af8-d196-4dd3-b8df-9b98089c1606 with Priority: HIGHEST for action security_group_rules [ 598.803244] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1d35af8-d196-4dd3-b8df-9b98089c1606 with Priority: HIGHEST for action security_group_rules [ 598.803765] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1d35af8-d196-4dd3-b8df-9b98089c1606 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.804572] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1d35af8-d196-4dd3-b8df-9b98089c1606" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.804572] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1d35af8-d196-4dd3-b8df-9b98089c1606" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.804985] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1d35af8-d196-4dd3-b8df-9b98089c1606" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.804985] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1d35af8-d196-4dd3-b8df-9b98089c1606',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.811284] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.811486] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.811611] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.811984] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.812204] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.812410] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-c5d6db45-dd82-4518-a5a2-a73a50a46d49" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.820783] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.821141] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.821223] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.822150] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.822150] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.822150] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ccb27bcf-56d8-49d9-af51-9eb4b1211bce is going to be updated. [ 598.834645] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.834854] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.834854] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.835671] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.835671] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.859616] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 in Status: UNINITIALIZED for 2s [ 598.879268] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.882344] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.882344] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.882344] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.882344] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.892425] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccb27bcf-56d8-49d9-af51-9eb4b1211bce in Status: IN_PROGRESS for 2s [ 598.919737] env[62842]: INFO networking_nsxv3.common.synchronization [None req-133ac337-62ae-49aa-89db-660b486c8062 tempest-ServersTestBootFromVolume-595571146 tempest-ServersTestBootFromVolume-595571146-project-member] Enqueued Resource ID: d1d35af8-d196-4dd3-b8df-9b98089c1606 with Priority: HIGHEST for action security_group_rules [ 598.920323] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1d35af8-d196-4dd3-b8df-9b98089c1606 with Priority: HIGHEST for action security_group_rules [ 598.920629] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1d35af8-d196-4dd3-b8df-9b98089c1606 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.920743] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1d35af8-d196-4dd3-b8df-9b98089c1606" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.000408] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 15733f0a-5238-4c30-a652-f2d51b500914 [ 599.000839] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.000962] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.001067] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.001486] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.001486] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.001604] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:15733f0a-5238-4c30-a652-f2d51b500914 already deleted. [ 599.001649] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-15733f0a-5238-4c30-a652-f2d51b500914" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.165655] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1648554a-7f11-49bf-b9b2-6edf888e2ce9',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.334017] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.334017] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.334017] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.334017] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.334294] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.334294] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1d35af8-d196-4dd3-b8df-9b98089c1606 already deleted. [ 599.334366] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1d35af8-d196-4dd3-b8df-9b98089c1606" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.334640] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1d35af8-d196-4dd3-b8df-9b98089c1606" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.335036] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1d35af8-d196-4dd3-b8df-9b98089c1606" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.335036] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1d35af8-d196-4dd3-b8df-9b98089c1606',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.347025] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5704e4e3-8211-4e30-b474-06c668cf060d in Status: SUCCESS [ 599.347025] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.347025] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.347025] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.347025] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.347025] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.347025] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.347025] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.347025] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.347025] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.347025] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5704e4e3-8211-4e30-b474-06c668cf060d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.347025] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.347025] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.347838] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.347838] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.347838] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.347838] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.347838] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.347838] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5704e4e3-8211-4e30-b474-06c668cf060d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.670477] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1648554a-7f11-49bf-b9b2-6edf888e2ce9: rpc.has_security_group_logging(os_id): False [ 599.698847] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.699038] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.699112] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.699324] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.699415] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.699642] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.699731] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.699794] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.699965] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.700085] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.700174] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1648554a-7f11-49bf-b9b2-6edf888e2ce9 is going to be created. [ 599.790965] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.791200] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.793766] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.794735] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.795078] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.828886] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1648554a-7f11-49bf-b9b2-6edf888e2ce9 in Status: IN_PROGRESS for 2s [ 599.842300] env[62842]: INFO networking_nsxv3.common.synchronization [req-5264653a-c6bf-4877-8dc6-6c275100b1cc req-d2c97bc1-e8bd-4991-a5ba-4504c193b247 tempest-ListServerFiltersTestJSON-2112811092 tempest-ListServerFiltersTestJSON-2112811092-project-member] Enqueued Resource ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 with Priority: HIGHEST for action security_group_members [ 599.843514] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 with Priority: HIGHEST for action security_group_members [ 599.843869] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-331dd47d-e3b4-4338-b588-cd456a9aa5f7 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.844024] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.844095] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.844324] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.844483] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.844587] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.844645] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.845460] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.845460] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.845460] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('331dd47d-e3b4-4338-b588-cd456a9aa5f7',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.850279] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5704e4e3-8211-4e30-b474-06c668cf060d taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.850455] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.850596] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5704e4e3-8211-4e30-b474-06c668cf060d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.867981] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.867981] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.867981] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.867981] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.867981] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.867981] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1d35af8-d196-4dd3-b8df-9b98089c1606 already deleted. [ 599.867981] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1d35af8-d196-4dd3-b8df-9b98089c1606" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.880246] env[62842]: INFO networking_nsxv3.common.synchronization [req-c9533fe9-dc9e-4063-8d84-01e853365869 req-fd2bdb04-bdd7-4761-9b71-397364ad8f82 service nova] Enqueued Resource ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 with Priority: HIGHEST for action security_group_rules [ 599.880246] env[62842]: INFO networking_nsxv3.common.synchronization [req-c9533fe9-dc9e-4063-8d84-01e853365869 req-fd2bdb04-bdd7-4761-9b71-397364ad8f82 service nova] Enqueued Resource ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 with Priority: HIGHEST for action security_group_members [ 599.880246] env[62842]: INFO networking_nsxv3.common.synchronization [req-c9533fe9-dc9e-4063-8d84-01e853365869 req-fd2bdb04-bdd7-4761-9b71-397364ad8f82 service nova] Enqueued Resource ID: c5d6db45-dd82-4518-a5a2-a73a50a46d49 with Priority: HIGHEST for action port [ 599.880817] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 with Priority: HIGHEST for action security_group_rules [ 599.881199] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 with Priority: HIGHEST for action security_group_members [ 599.881417] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5d6db45-dd82-4518-a5a2-a73a50a46d49 with Priority: HIGHEST for action port [ 599.882497] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-331dd47d-e3b4-4338-b588-cd456a9aa5f7 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.882497] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.882497] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.882954] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.883171] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('331dd47d-e3b4-4338-b588-cd456a9aa5f7',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.886019] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-331dd47d-e3b4-4338-b588-cd456a9aa5f7 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.886019] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.886019] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5d6db45-dd82-4518-a5a2-a73a50a46d49 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.886019] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5d6db45-dd82-4518-a5a2-a73a50a46d49" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.886019] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5d6db45-dd82-4518-a5a2-a73a50a46d49" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.886019] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5d6db45-dd82-4518-a5a2-a73a50a46d49" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.886019] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5d6db45-dd82-4518-a5a2-a73a50a46d49',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.349356] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('331dd47d-e3b4-4338-b588-cd456a9aa5f7',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.354880] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5704e4e3-8211-4e30-b474-06c668cf060d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.389272] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-331dd47d-e3b4-4338-b588-cd456a9aa5f7 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.389272] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.389272] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-170 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.389272] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-170" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.389272] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-170" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.389736] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-170" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.389736] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.389736] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.389862] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.391599] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.391708] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.393372] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 600.394784] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 600.394997] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 600.395183] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 600.395453] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 600.395493] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 600.395666] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 600.396948] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c5d6db45-dd82-4518-a5a2-a73a50a46d49 with status ACTIVE [ 600.397181] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.397275] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.397362] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.397582] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.397696] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.397925] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.400391] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.402084] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.402084] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.402084] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.402084] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.402084] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.402084] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.402084] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.402084] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.402084] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c5d6db45-dd82-4518-a5a2-a73a50a46d49 is going to be updated. [ 600.428577] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 600.428577] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 600.428577] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 600.428577] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-170" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.428577] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-a816129d-36f7-4736-9d9f-11d25d23c7b1 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.428577] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-a816129d-36f7-4736-9d9f-11d25d23c7b1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.428577] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-a816129d-36f7-4736-9d9f-11d25d23c7b1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.428879] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-a816129d-36f7-4736-9d9f-11d25d23c7b1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.428879] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a816129d-36f7-4736-9d9f-11d25d23c7b1',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.434313] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.434313] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.434313] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.434313] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.434313] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.434313] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5d6db45-dd82-4518-a5a2-a73a50a46d49" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.434313] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ccb27bcf-56d8-49d9-af51-9eb4b1211bce in Status: SUCCESS [ 600.434313] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ccb27bcf-56d8-49d9-af51-9eb4b1211bce" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.434313] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ccb27bcf-56d8-49d9-af51-9eb4b1211bce" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.434313] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ccb27bcf-56d8-49d9-af51-9eb4b1211bce" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.434313] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ccb27bcf-56d8-49d9-af51-9eb4b1211bce',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.475769] env[62842]: INFO networking_nsxv3.common.synchronization [None req-64e7325f-7dcd-4e29-b193-05428d48a407 None None] Enqueued Resource ID: bf98e4f5-a0f7-41d9-9ded-d2232ec473f1 with Priority: HIGHEST for action port [ 600.475769] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf98e4f5-a0f7-41d9-9ded-d2232ec473f1 with Priority: HIGHEST for action port [ 600.475769] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf98e4f5-a0f7-41d9-9ded-d2232ec473f1 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.475769] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf98e4f5-a0f7-41d9-9ded-d2232ec473f1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.475769] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf98e4f5-a0f7-41d9-9ded-d2232ec473f1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.475985] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf98e4f5-a0f7-41d9-9ded-d2232ec473f1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.475985] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf98e4f5-a0f7-41d9-9ded-d2232ec473f1',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.851624] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('331dd47d-e3b4-4338-b588-cd456a9aa5f7',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.859139] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.859139] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.859139] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.859139] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.859139] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.859139] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5704e4e3-8211-4e30-b474-06c668cf060d is going to be updated. [ 600.875782] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 in Status: SUCCESS [ 600.875782] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.875782] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.875782] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.875928] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.875984] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.876056] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.876209] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.876291] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.876389] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.876472] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0a03224f-b75b-48a5-9e23-3ca50aabbb33',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.892959] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.892959] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.892959] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.892959] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.892959] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.902975] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5704e4e3-8211-4e30-b474-06c668cf060d in Status: IN_PROGRESS for 2s [ 600.905123] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccb27bcf-56d8-49d9-af51-9eb4b1211bce in Status: SUCCESS [ 600.905123] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccb27bcf-56d8-49d9-af51-9eb4b1211bce" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.905123] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccb27bcf-56d8-49d9-af51-9eb4b1211bce" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.905123] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccb27bcf-56d8-49d9-af51-9eb4b1211bce" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.905123] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.905123] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.905123] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.905640] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.905762] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.908298] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ccb27bcf-56d8-49d9-af51-9eb4b1211bce',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.932510] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.932510] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.932510] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.933030] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.933509] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.934372] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port a816129d-36f7-4736-9d9f-11d25d23c7b1 not found, creating... [ 600.934650] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.935118] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.935118] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.935472] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.936129] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.936425] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.937521] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.937521] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.937521] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.937521] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.937521] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: a816129d-36f7-4736-9d9f-11d25d23c7b1 is going to be created. [ 600.939489] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccb27bcf-56d8-49d9-af51-9eb4b1211bce taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.939489] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccb27bcf-56d8-49d9-af51-9eb4b1211bce" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.962996] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.962996] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.962996] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.962996] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.962996] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.962996] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-a816129d-36f7-4736-9d9f-11d25d23c7b1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.979939] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bf98e4f5-a0f7-41d9-9ded-d2232ec473f1 [ 600.979939] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.979939] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.979939] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.979939] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.979939] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.979939] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bf98e4f5-a0f7-41d9-9ded-d2232ec473f1 already deleted. [ 600.979939] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf98e4f5-a0f7-41d9-9ded-d2232ec473f1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.353831] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.354057] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.354111] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.354302] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.354395] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.354495] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 is going to be created. [ 601.380873] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0a03224f-b75b-48a5-9e23-3ca50aabbb33',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.387379] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.387379] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.387379] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.387379] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.387379] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.410087] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 in Status: UNINITIALIZED for 2s [ 601.410310] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ccb27bcf-56d8-49d9-af51-9eb4b1211bce',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.770235] env[62842]: INFO networking_nsxv3.common.synchronization [req-5264653a-c6bf-4877-8dc6-6c275100b1cc req-4a77ca14-851c-4fcc-b7f3-cb47750ee04c service nova] Enqueued Resource ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 with Priority: HIGHEST for action security_group_rules [ 601.770235] env[62842]: INFO networking_nsxv3.common.synchronization [req-5264653a-c6bf-4877-8dc6-6c275100b1cc req-4a77ca14-851c-4fcc-b7f3-cb47750ee04c service nova] Enqueued Resource ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 with Priority: HIGHEST for action security_group_members [ 601.770235] env[62842]: INFO networking_nsxv3.common.synchronization [req-5264653a-c6bf-4877-8dc6-6c275100b1cc req-4a77ca14-851c-4fcc-b7f3-cb47750ee04c service nova] Enqueued Resource ID: a816129d-36f7-4736-9d9f-11d25d23c7b1 with Priority: HIGHEST for action port [ 601.770235] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 with Priority: HIGHEST for action security_group_rules [ 601.770499] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 with Priority: HIGHEST for action security_group_members [ 601.770499] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a816129d-36f7-4736-9d9f-11d25d23c7b1 with Priority: HIGHEST for action port [ 601.772161] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-331dd47d-e3b4-4338-b588-cd456a9aa5f7 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.772369] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.772626] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-331dd47d-e3b4-4338-b588-cd456a9aa5f7 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.772719] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.772930] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-a816129d-36f7-4736-9d9f-11d25d23c7b1 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.773012] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a816129d-36f7-4736-9d9f-11d25d23c7b1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.773118] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a816129d-36f7-4736-9d9f-11d25d23c7b1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.773284] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a816129d-36f7-4736-9d9f-11d25d23c7b1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.773363] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a816129d-36f7-4736-9d9f-11d25d23c7b1',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.844489] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1648554a-7f11-49bf-b9b2-6edf888e2ce9 in Status: SUCCESS [ 601.844592] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1648554a-7f11-49bf-b9b2-6edf888e2ce9" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.890232] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0a03224f-b75b-48a5-9e23-3ca50aabbb33: rpc.has_security_group_logging(os_id): False [ 601.916279] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.916440] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.916511] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.917020] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.917020] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.917138] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.917243] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.917275] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.917450] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.917530] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.917637] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 is going to be created. [ 601.919058] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ccb27bcf-56d8-49d9-af51-9eb4b1211bce',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.001946] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.002127] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.002203] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.002423] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.002623] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.015236] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 in Status: IN_PROGRESS for 2s [ 602.270953] env[62842]: INFO networking_nsxv3.common.synchronization [req-fb5ddad4-49c7-4658-b4db-111ceebe3a9a req-c6c9aac3-f529-4d8c-91ee-8807a41acb9d tempest-VolumesAdminNegativeTest-1647971171 tempest-VolumesAdminNegativeTest-1647971171-project-member] Enqueued Resource ID: 38065a18-23d4-472c-902b-3e37fa7fb4aa with Priority: HIGHEST for action security_group_members [ 602.270953] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38065a18-23d4-472c-902b-3e37fa7fb4aa with Priority: HIGHEST for action security_group_members [ 602.270953] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-38065a18-23d4-472c-902b-3e37fa7fb4aa taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.272472] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38065a18-23d4-472c-902b-3e37fa7fb4aa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.275731] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38065a18-23d4-472c-902b-3e37fa7fb4aa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.275731] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38065a18-23d4-472c-902b-3e37fa7fb4aa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.275731] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.275731] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.275731] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.275731] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.275731] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.275731] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38065a18-23d4-472c-902b-3e37fa7fb4aa',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.275731] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a816129d-36f7-4736-9d9f-11d25d23c7b1 with status ACTIVE [ 602.277070] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.278029] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.279845] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.279845] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.279845] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.279845] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.279845] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.279845] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.279845] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.281029] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.281029] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.281029] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.281029] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.281029] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.281280] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.281280] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a816129d-36f7-4736-9d9f-11d25d23c7b1 is going to be updated. [ 602.308253] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.308253] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.308253] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.308253] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.308496] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.308555] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a816129d-36f7-4736-9d9f-11d25d23c7b1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.422379] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.422649] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.422649] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.423602] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.423602] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.423602] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ccb27bcf-56d8-49d9-af51-9eb4b1211bce is going to be updated. [ 602.511328] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.511328] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.511569] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.513385] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.513385] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.526346] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccb27bcf-56d8-49d9-af51-9eb4b1211bce in Status: IN_PROGRESS for 2s [ 602.784029] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.784253] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.784253] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.784563] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.784667] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.784894] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.785045] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.785144] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.785342] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.785453] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.785561] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38065a18-23d4-472c-902b-3e37fa7fb4aa already deleted. [ 602.785652] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38065a18-23d4-472c-902b-3e37fa7fb4aa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.819430] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-340 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.819664] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-340" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.820219] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-340" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.820219] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-340" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.820541] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.820706] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.820837] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.821651] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.821651] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.824133] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 602.824133] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 602.824133] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 602.824133] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 602.824133] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 602.824133] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 602.824133] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 602.855394] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 602.855394] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 602.855394] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 602.855394] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-340" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.855394] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-e3aa193c-0c48-4ad3-9f4e-9bb9ad23028d taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.855394] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-e3aa193c-0c48-4ad3-9f4e-9bb9ad23028d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.855394] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-e3aa193c-0c48-4ad3-9f4e-9bb9ad23028d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.855394] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-e3aa193c-0c48-4ad3-9f4e-9bb9ad23028d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.855394] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3aa193c-0c48-4ad3-9f4e-9bb9ad23028d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.917047] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5704e4e3-8211-4e30-b474-06c668cf060d in Status: SUCCESS [ 602.917047] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.917047] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.917436] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.917436] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.917721] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.917721] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.918080] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.918275] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.918344] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5704e4e3-8211-4e30-b474-06c668cf060d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.362140] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.362618] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.362875] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.363451] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.363736] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.363998] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port e3aa193c-0c48-4ad3-9f4e-9bb9ad23028d not found, creating... [ 603.364948] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.366444] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.367493] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.367493] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.367493] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.367682] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.367780] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.367995] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.370208] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.370208] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.370208] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: e3aa193c-0c48-4ad3-9f4e-9bb9ad23028d is going to be created. [ 603.411380] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.411588] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.411719] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.412043] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.412264] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.412493] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-e3aa193c-0c48-4ad3-9f4e-9bb9ad23028d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.420490] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5704e4e3-8211-4e30-b474-06c668cf060d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.428249] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 in Status: SUCCESS [ 603.428749] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.428749] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.428957] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.429247] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.429247] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.429247] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.429422] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.429505] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.429605] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('331dd47d-e3b4-4338-b588-cd456a9aa5f7',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.510106] env[62842]: INFO networking_nsxv3.common.synchronization [None req-56bcfb41-d387-4d3b-a213-db00c94ce382 None None] Enqueued Resource ID: f8fe8bfa-27b0-44e3-82f8-eb7de6a9ebf0 with Priority: HIGHEST for action port [ 603.511198] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8fe8bfa-27b0-44e3-82f8-eb7de6a9ebf0 with Priority: HIGHEST for action port [ 603.511564] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-f8fe8bfa-27b0-44e3-82f8-eb7de6a9ebf0 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.511691] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f8fe8bfa-27b0-44e3-82f8-eb7de6a9ebf0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.511691] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f8fe8bfa-27b0-44e3-82f8-eb7de6a9ebf0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.511948] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f8fe8bfa-27b0-44e3-82f8-eb7de6a9ebf0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.512045] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8fe8bfa-27b0-44e3-82f8-eb7de6a9ebf0',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.924576] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5704e4e3-8211-4e30-b474-06c668cf060d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.936085] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('331dd47d-e3b4-4338-b588-cd456a9aa5f7',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.015477] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f8fe8bfa-27b0-44e3-82f8-eb7de6a9ebf0 [ 604.015801] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.015982] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.015982] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.016679] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.016679] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.016679] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f8fe8bfa-27b0-44e3-82f8-eb7de6a9ebf0 already deleted. [ 604.016679] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f8fe8bfa-27b0-44e3-82f8-eb7de6a9ebf0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.030867] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 in Status: SUCCESS [ 604.031118] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.434714] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.435449] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.435449] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.435449] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.435991] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.435991] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5704e4e3-8211-4e30-b474-06c668cf060d is going to be updated. [ 604.445054] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('331dd47d-e3b4-4338-b588-cd456a9aa5f7',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.480515] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.480515] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.480515] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.480515] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.480515] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.497052] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5704e4e3-8211-4e30-b474-06c668cf060d in Status: IN_PROGRESS for 2s [ 604.540816] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccb27bcf-56d8-49d9-af51-9eb4b1211bce in Status: SUCCESS [ 604.542690] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccb27bcf-56d8-49d9-af51-9eb4b1211bce" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.542690] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccb27bcf-56d8-49d9-af51-9eb4b1211bce" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.542690] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccb27bcf-56d8-49d9-af51-9eb4b1211bce" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.542690] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.542690] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.542690] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.542690] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.543473] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.543473] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccb27bcf-56d8-49d9-af51-9eb4b1211bce" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.543473] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ccb27bcf-56d8-49d9-af51-9eb4b1211bce',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.651643] env[62842]: INFO networking_nsxv3.common.synchronization [req-fb5ddad4-49c7-4658-b4db-111ceebe3a9a req-fd03afd0-4dfe-4bb0-a51b-4eccf07f899e service nova] Enqueued Resource ID: 38065a18-23d4-472c-902b-3e37fa7fb4aa with Priority: HIGHEST for action security_group_rules [ 604.653951] env[62842]: INFO networking_nsxv3.common.synchronization [req-fb5ddad4-49c7-4658-b4db-111ceebe3a9a req-fd03afd0-4dfe-4bb0-a51b-4eccf07f899e service nova] Enqueued Resource ID: 38065a18-23d4-472c-902b-3e37fa7fb4aa with Priority: HIGHEST for action security_group_members [ 604.654155] env[62842]: INFO networking_nsxv3.common.synchronization [req-fb5ddad4-49c7-4658-b4db-111ceebe3a9a req-fd03afd0-4dfe-4bb0-a51b-4eccf07f899e service nova] Enqueued Resource ID: e3aa193c-0c48-4ad3-9f4e-9bb9ad23028d with Priority: HIGHEST for action port [ 604.654852] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38065a18-23d4-472c-902b-3e37fa7fb4aa with Priority: HIGHEST for action security_group_rules [ 604.654995] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38065a18-23d4-472c-902b-3e37fa7fb4aa with Priority: HIGHEST for action security_group_members [ 604.655118] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3aa193c-0c48-4ad3-9f4e-9bb9ad23028d with Priority: HIGHEST for action port [ 604.655408] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-38065a18-23d4-472c-902b-3e37fa7fb4aa taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.655553] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-38065a18-23d4-472c-902b-3e37fa7fb4aa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.655629] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-38065a18-23d4-472c-902b-3e37fa7fb4aa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.655920] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-38065a18-23d4-472c-902b-3e37fa7fb4aa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.656020] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('38065a18-23d4-472c-902b-3e37fa7fb4aa',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.657077] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-38065a18-23d4-472c-902b-3e37fa7fb4aa taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.657224] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38065a18-23d4-472c-902b-3e37fa7fb4aa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.657317] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38065a18-23d4-472c-902b-3e37fa7fb4aa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.657497] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38065a18-23d4-472c-902b-3e37fa7fb4aa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.657670] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.657771] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.657844] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.658025] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.658116] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.658214] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38065a18-23d4-472c-902b-3e37fa7fb4aa',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.659212] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-e3aa193c-0c48-4ad3-9f4e-9bb9ad23028d taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.659362] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e3aa193c-0c48-4ad3-9f4e-9bb9ad23028d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.659405] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e3aa193c-0c48-4ad3-9f4e-9bb9ad23028d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.659830] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e3aa193c-0c48-4ad3-9f4e-9bb9ad23028d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.659830] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3aa193c-0c48-4ad3-9f4e-9bb9ad23028d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.950025] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.950025] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.950025] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.950025] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.950025] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.950025] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 is going to be updated. [ 604.990068] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.990068] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.990068] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.990068] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.990068] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.004635] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 in Status: IN_PROGRESS for 2s [ 605.047491] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ccb27bcf-56d8-49d9-af51-9eb4b1211bce',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.157241] env[62842]: INFO networking_nsxv3.common.synchronization [req-b3fcb3b9-bcce-43ad-b25d-2786d39ef7a5 req-1a23f34a-5183-44b2-bf5e-34e961ad52b3 tempest-ListServerFiltersTestJSON-2112811092 tempest-ListServerFiltersTestJSON-2112811092-project-member] Enqueued Resource ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 with Priority: HIGHEST for action security_group_members [ 605.157945] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 with Priority: HIGHEST for action security_group_members [ 605.162965] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-331dd47d-e3b4-4338-b588-cd456a9aa5f7 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.162965] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.163539] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-38065a18-23d4-472c-902b-3e37fa7fb4aa taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.163671] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38065a18-23d4-472c-902b-3e37fa7fb4aa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.163885] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('38065a18-23d4-472c-902b-3e37fa7fb4aa',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.164832] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e3aa193c-0c48-4ad3-9f4e-9bb9ad23028d with status ACTIVE [ 605.168664] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.168664] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.168664] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.168664] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.168664] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.168664] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.168664] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.168664] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.168664] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.168664] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.169713] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.169991] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.170188] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.170487] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.170693] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.170906] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e3aa193c-0c48-4ad3-9f4e-9bb9ad23028d is going to be updated. [ 605.208311] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.208311] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.208311] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.208311] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.208311] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.208311] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e3aa193c-0c48-4ad3-9f4e-9bb9ad23028d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.553392] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ccb27bcf-56d8-49d9-af51-9eb4b1211bce: rpc.has_security_group_logging(os_id): False [ 605.572202] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.572395] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.572473] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.572742] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.572848] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.573098] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.573203] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.573262] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.573430] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.573511] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.573602] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ccb27bcf-56d8-49d9-af51-9eb4b1211bce is going to be updated. [ 605.633018] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.633018] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.633018] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.633314] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.633350] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.652052] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ccb27bcf-56d8-49d9-af51-9eb4b1211bce in Status: IN_PROGRESS for 2s [ 605.675193] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('38065a18-23d4-472c-902b-3e37fa7fb4aa',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.771683] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-170 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.771818] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-170" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.771858] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-170" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.772172] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-170" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.772437] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.772599] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.772717] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.772944] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.776032] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.776032] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 605.776032] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 605.776032] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 605.776032] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 605.776032] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 605.776032] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 605.776032] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 605.809750] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 605.812168] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 605.812168] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 605.812168] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-170" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.812168] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-3676563e-4291-4266-89c4-5d4c70f8658a taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.812168] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-3676563e-4291-4266-89c4-5d4c70f8658a" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.812168] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-3676563e-4291-4266-89c4-5d4c70f8658a" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.812168] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-3676563e-4291-4266-89c4-5d4c70f8658a" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.812168] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3676563e-4291-4266-89c4-5d4c70f8658a',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.179715] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.179715] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.179715] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.179715] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.179715] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.179715] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38065a18-23d4-472c-902b-3e37fa7fb4aa is going to be created. [ 606.205657] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.205956] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.207418] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.207418] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.207418] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.221844] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38065a18-23d4-472c-902b-3e37fa7fb4aa in Status: UNINITIALIZED for 2s [ 606.315490] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.315790] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.315950] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.316317] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.316494] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.316678] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 3676563e-4291-4266-89c4-5d4c70f8658a not found, creating... [ 606.317077] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.317325] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.317479] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.320983] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.321241] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.321827] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.322282] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.322353] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.322633] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.322831] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.322996] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 3676563e-4291-4266-89c4-5d4c70f8658a is going to be created. [ 606.350027] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.350027] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.350027] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.350027] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.350027] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.350027] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-3676563e-4291-4266-89c4-5d4c70f8658a" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.515535] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5704e4e3-8211-4e30-b474-06c668cf060d in Status: SUCCESS [ 606.515535] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.516806] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.517540] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.518827] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.518827] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.518827] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.518827] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.518827] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.518827] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.518827] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5704e4e3-8211-4e30-b474-06c668cf060d taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.519650] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.525161] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.525161] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.525161] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.525161] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.525161] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.525161] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.525161] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.525161] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.525161] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5704e4e3-8211-4e30-b474-06c668cf060d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.018242] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 in Status: SUCCESS [ 607.018242] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.018443] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.018691] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.018991] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.019193] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.019347] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.019604] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.019727] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.019946] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.020387] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('331dd47d-e3b4-4338-b588-cd456a9aa5f7',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.021177] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.022163] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.022247] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.022312] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.023806] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.024066] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.025418] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.025418] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('331dd47d-e3b4-4338-b588-cd456a9aa5f7',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.029560] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5704e4e3-8211-4e30-b474-06c668cf060d: rpc.has_security_group_logging(os_id): False [ 607.053602] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.053875] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.053875] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.054085] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.054177] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.054391] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.054516] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.054582] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.054709] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.054777] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.054997] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.055184] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.055184] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.055353] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.055353] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.055534] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.055642] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.055742] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.055856] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.055900] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.056073] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5704e4e3-8211-4e30-b474-06c668cf060d is going to be updated. [ 607.135924] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.136106] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.136202] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.136459] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.138729] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.156287] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5704e4e3-8211-4e30-b474-06c668cf060d in Status: IN_PROGRESS for 2s [ 607.530920] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('331dd47d-e3b4-4338-b588-cd456a9aa5f7',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.532248] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-331dd47d-e3b4-4338-b588-cd456a9aa5f7 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.532418] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.669190] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ccb27bcf-56d8-49d9-af51-9eb4b1211bce in Status: SUCCESS [ 607.669684] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ccb27bcf-56d8-49d9-af51-9eb4b1211bce" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.034131] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('331dd47d-e3b4-4338-b588-cd456a9aa5f7',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.137870] env[62842]: INFO networking_nsxv3.common.synchronization [req-5192936b-bc24-417b-ba7f-6c2dbea2f7d5 req-b2839e0f-57f8-4d90-96a2-54210dbde22e tempest-ListImageFiltersTestJSON-20601446 tempest-ListImageFiltersTestJSON-20601446-project-member] Enqueued Resource ID: fe43e864-555f-4ea5-8841-d2bcacb15ecc with Priority: HIGHEST for action security_group_members [ 608.138488] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe43e864-555f-4ea5-8841-d2bcacb15ecc with Priority: HIGHEST for action security_group_members [ 608.138903] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe43e864-555f-4ea5-8841-d2bcacb15ecc taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.143274] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.143274] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.143580] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.143989] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.143989] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.144182] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.144775] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.144775] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.144775] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe43e864-555f-4ea5-8841-d2bcacb15ecc',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.207522] env[62842]: INFO networking_nsxv3.common.synchronization [req-b3fcb3b9-bcce-43ad-b25d-2786d39ef7a5 req-5beff692-0463-4326-9184-e5d61647d079 service nova] Enqueued Resource ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 with Priority: HIGHEST for action security_group_rules [ 608.207522] env[62842]: INFO networking_nsxv3.common.synchronization [req-b3fcb3b9-bcce-43ad-b25d-2786d39ef7a5 req-5beff692-0463-4326-9184-e5d61647d079 service nova] Enqueued Resource ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 with Priority: HIGHEST for action security_group_members [ 608.207729] env[62842]: INFO networking_nsxv3.common.synchronization [req-b3fcb3b9-bcce-43ad-b25d-2786d39ef7a5 req-5beff692-0463-4326-9184-e5d61647d079 service nova] Enqueued Resource ID: 3676563e-4291-4266-89c4-5d4c70f8658a with Priority: HIGHEST for action port [ 608.207902] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 with Priority: HIGHEST for action security_group_rules [ 608.208134] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 with Priority: HIGHEST for action security_group_members [ 608.208236] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3676563e-4291-4266-89c4-5d4c70f8658a with Priority: HIGHEST for action port [ 608.209280] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-331dd47d-e3b4-4338-b588-cd456a9aa5f7 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.211458] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.211781] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-331dd47d-e3b4-4338-b588-cd456a9aa5f7 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.211907] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.212152] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-3676563e-4291-4266-89c4-5d4c70f8658a taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.212387] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3676563e-4291-4266-89c4-5d4c70f8658a" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.212387] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3676563e-4291-4266-89c4-5d4c70f8658a" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.213509] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3676563e-4291-4266-89c4-5d4c70f8658a" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.213509] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3676563e-4291-4266-89c4-5d4c70f8658a',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.234687] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38065a18-23d4-472c-902b-3e37fa7fb4aa in Status: SUCCESS [ 608.236259] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38065a18-23d4-472c-902b-3e37fa7fb4aa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.236562] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38065a18-23d4-472c-902b-3e37fa7fb4aa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.236870] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38065a18-23d4-472c-902b-3e37fa7fb4aa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.237180] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.237419] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.237570] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.237933] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.238144] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.238328] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38065a18-23d4-472c-902b-3e37fa7fb4aa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.239212] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('38065a18-23d4-472c-902b-3e37fa7fb4aa',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.539450] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.539745] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.539745] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.539925] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.540014] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.542308] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 is going to be updated. [ 608.648172] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.648481] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.648481] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.648591] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.648824] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.648973] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.649064] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.649117] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.649376] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.649376] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.649498] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe43e864-555f-4ea5-8841-d2bcacb15ecc already deleted. [ 608.649541] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.714785] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3676563e-4291-4266-89c4-5d4c70f8658a with status ACTIVE [ 608.715561] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.715561] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.715561] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.715561] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.715561] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.715773] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.715854] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.715887] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.716047] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.716132] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.716313] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.716440] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.716491] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.719687] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.719687] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.719687] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3676563e-4291-4266-89c4-5d4c70f8658a is going to be updated. [ 608.734658] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.734843] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.735801] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.735801] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.735801] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.742288] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-38065a18-23d4-472c-902b-3e37fa7fb4aa taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.742288] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38065a18-23d4-472c-902b-3e37fa7fb4aa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.742288] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38065a18-23d4-472c-902b-3e37fa7fb4aa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.742510] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38065a18-23d4-472c-902b-3e37fa7fb4aa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.742736] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.742850] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.742916] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.743138] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.743245] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.743365] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38065a18-23d4-472c-902b-3e37fa7fb4aa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.743578] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-38065a18-23d4-472c-902b-3e37fa7fb4aa taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.743640] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38065a18-23d4-472c-902b-3e37fa7fb4aa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.743690] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38065a18-23d4-472c-902b-3e37fa7fb4aa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.743827] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38065a18-23d4-472c-902b-3e37fa7fb4aa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.743967] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.744081] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.744142] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.744284] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.744362] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.744443] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38065a18-23d4-472c-902b-3e37fa7fb4aa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.745028] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('38065a18-23d4-472c-902b-3e37fa7fb4aa',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.752407] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 in Status: IN_PROGRESS for 2s [ 608.774041] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.774041] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.774273] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.774334] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.774554] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.774654] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3676563e-4291-4266-89c4-5d4c70f8658a" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.146062] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-938 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.148267] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-938" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.148574] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-938" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.149540] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-938" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.149928] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.151031] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.151109] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.151382] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.151914] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.151914] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 609.151914] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 609.152100] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 609.152157] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 609.152345] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 609.152386] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 609.152535] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 609.174747] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5704e4e3-8211-4e30-b474-06c668cf060d in Status: SUCCESS [ 609.174747] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.174747] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.174747] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.176870] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5704e4e3-8211-4e30-b474-06c668cf060d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.183927] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 609.185190] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 609.185190] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 609.186141] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-938" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.186141] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-e200ff60-852b-4a04-ad0a-7a1dc410969f taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.186141] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-e200ff60-852b-4a04-ad0a-7a1dc410969f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.186141] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-e200ff60-852b-4a04-ad0a-7a1dc410969f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.186328] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-e200ff60-852b-4a04-ad0a-7a1dc410969f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.186452] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e200ff60-852b-4a04-ad0a-7a1dc410969f',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.246745] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 38065a18-23d4-472c-902b-3e37fa7fb4aa: rpc.has_security_group_logging(os_id): False [ 609.271356] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.272974] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.272974] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.272974] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.272974] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.272974] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.273232] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.273232] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.273306] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.274155] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.274155] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.274155] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.274155] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.274155] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.274481] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.275130] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.275252] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.275314] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.275469] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.275543] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.275630] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 38065a18-23d4-472c-902b-3e37fa7fb4aa is going to be created. [ 609.358576] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.358576] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.358576] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.358794] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.358970] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.372901] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 38065a18-23d4-472c-902b-3e37fa7fb4aa in Status: IN_PROGRESS for 2s [ 609.684360] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5704e4e3-8211-4e30-b474-06c668cf060d taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.684718] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.684718] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.684863] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.685062] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.685167] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.685218] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.685375] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.685471] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.685562] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.685821] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5704e4e3-8211-4e30-b474-06c668cf060d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.692240] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.692240] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.692364] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.692591] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.692664] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.692932] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port e200ff60-852b-4a04-ad0a-7a1dc410969f not found, creating... [ 609.693096] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.693260] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.693448] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.693597] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.693736] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.695961] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.696204] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.696352] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.696603] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.696774] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.696920] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: e200ff60-852b-4a04-ad0a-7a1dc410969f is going to be created. [ 609.719980] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.719980] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.719980] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.719980] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.719980] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.719980] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-e200ff60-852b-4a04-ad0a-7a1dc410969f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.193426] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5704e4e3-8211-4e30-b474-06c668cf060d taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.193426] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.193426] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.193426] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.193426] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.193426] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.193426] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.193426] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.193951] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.193951] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.193951] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5704e4e3-8211-4e30-b474-06c668cf060d taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.194305] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.194305] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.194506] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.194678] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.194789] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.194866] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.195365] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.195476] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.195572] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.195695] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5704e4e3-8211-4e30-b474-06c668cf060d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.698517] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5704e4e3-8211-4e30-b474-06c668cf060d: rpc.has_security_group_logging(os_id): False [ 610.718345] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.718547] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.718601] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.718880] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.718956] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.719662] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.719662] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.719662] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.719662] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.719662] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.719930] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.719930] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.720026] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.720336] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.720434] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.723018] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.723018] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.723018] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.723018] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.723267] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.723727] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5704e4e3-8211-4e30-b474-06c668cf060d is going to be updated. [ 610.762863] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 in Status: SUCCESS [ 610.762863] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.763114] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.763263] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.763441] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.763597] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.764125] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.764125] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.764125] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.764125] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('331dd47d-e3b4-4338-b588-cd456a9aa5f7',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.826441] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.826704] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.826704] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.826915] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.827049] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.842603] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5704e4e3-8211-4e30-b474-06c668cf060d in Status: IN_PROGRESS for 2s [ 611.102648] env[62842]: INFO networking_nsxv3.common.synchronization [req-5192936b-bc24-417b-ba7f-6c2dbea2f7d5 req-ff6910ad-1aba-474c-835f-610ed9395c9c service nova] Enqueued Resource ID: fe43e864-555f-4ea5-8841-d2bcacb15ecc with Priority: HIGHEST for action security_group_rules [ 611.102915] env[62842]: INFO networking_nsxv3.common.synchronization [req-5192936b-bc24-417b-ba7f-6c2dbea2f7d5 req-ff6910ad-1aba-474c-835f-610ed9395c9c service nova] Enqueued Resource ID: fe43e864-555f-4ea5-8841-d2bcacb15ecc with Priority: HIGHEST for action security_group_members [ 611.102983] env[62842]: INFO networking_nsxv3.common.synchronization [req-5192936b-bc24-417b-ba7f-6c2dbea2f7d5 req-ff6910ad-1aba-474c-835f-610ed9395c9c service nova] Enqueued Resource ID: e200ff60-852b-4a04-ad0a-7a1dc410969f with Priority: HIGHEST for action port [ 611.103611] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe43e864-555f-4ea5-8841-d2bcacb15ecc with Priority: HIGHEST for action security_group_rules [ 611.104157] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe43e864-555f-4ea5-8841-d2bcacb15ecc with Priority: HIGHEST for action security_group_members [ 611.104157] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e200ff60-852b-4a04-ad0a-7a1dc410969f with Priority: HIGHEST for action port [ 611.104743] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fe43e864-555f-4ea5-8841-d2bcacb15ecc taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.104976] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.105085] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.105453] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.105560] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fe43e864-555f-4ea5-8841-d2bcacb15ecc',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.106971] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe43e864-555f-4ea5-8841-d2bcacb15ecc taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.107107] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.107174] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.107367] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.107550] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.107646] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.107711] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.107887] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.108012] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.109034] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe43e864-555f-4ea5-8841-d2bcacb15ecc',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.110391] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-e200ff60-852b-4a04-ad0a-7a1dc410969f taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.110665] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e200ff60-852b-4a04-ad0a-7a1dc410969f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.110665] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e200ff60-852b-4a04-ad0a-7a1dc410969f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.111669] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e200ff60-852b-4a04-ad0a-7a1dc410969f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.111669] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e200ff60-852b-4a04-ad0a-7a1dc410969f',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.267026] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('331dd47d-e3b4-4338-b588-cd456a9aa5f7',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.367248] env[62842]: INFO networking_nsxv3.common.synchronization [None req-5c380431-545a-4a82-9d47-3c5ac3777e2a None None] Enqueued Resource ID: 4b33702a-61dd-43ee-b8c6-17e6e0f16862 with Priority: HIGHEST for action port [ 611.369395] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b33702a-61dd-43ee-b8c6-17e6e0f16862 with Priority: HIGHEST for action port [ 611.369395] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b33702a-61dd-43ee-b8c6-17e6e0f16862 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.369395] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b33702a-61dd-43ee-b8c6-17e6e0f16862" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.369395] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b33702a-61dd-43ee-b8c6-17e6e0f16862" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.369395] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b33702a-61dd-43ee-b8c6-17e6e0f16862" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.369395] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b33702a-61dd-43ee-b8c6-17e6e0f16862',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.389785] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 38065a18-23d4-472c-902b-3e37fa7fb4aa in Status: SUCCESS [ 611.389785] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-38065a18-23d4-472c-902b-3e37fa7fb4aa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.613323] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fe43e864-555f-4ea5-8841-d2bcacb15ecc',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.614196] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe43e864-555f-4ea5-8841-d2bcacb15ecc taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.614352] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.614668] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e200ff60-852b-4a04-ad0a-7a1dc410969f with status ACTIVE [ 611.614933] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.614933] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.615109] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.615201] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.615286] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.615448] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.615539] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.615599] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.615750] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.615823] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.616081] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.616173] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.616211] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.616336] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.616414] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.616499] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e200ff60-852b-4a04-ad0a-7a1dc410969f is going to be updated. [ 611.644781] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.644965] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.645023] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.645214] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.645345] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.645505] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e200ff60-852b-4a04-ad0a-7a1dc410969f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.771565] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('331dd47d-e3b4-4338-b588-cd456a9aa5f7',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.802114] env[62842]: INFO networking_nsxv3.common.synchronization [None req-a7551edc-5fa7-45b4-a052-1f90a7c58c66 None None] Enqueued Resource ID: 40ad5302-74f5-4a10-84dc-42087244e054 with Priority: HIGHEST for action port [ 611.802999] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40ad5302-74f5-4a10-84dc-42087244e054 with Priority: HIGHEST for action port [ 611.803778] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-40ad5302-74f5-4a10-84dc-42087244e054 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.803920] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-40ad5302-74f5-4a10-84dc-42087244e054" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.804012] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-40ad5302-74f5-4a10-84dc-42087244e054" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.804355] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-40ad5302-74f5-4a10-84dc-42087244e054" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.804591] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40ad5302-74f5-4a10-84dc-42087244e054',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.877249] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4b33702a-61dd-43ee-b8c6-17e6e0f16862 [ 611.877665] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.877665] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.877831] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.877985] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.878070] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.878344] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4b33702a-61dd-43ee-b8c6-17e6e0f16862 already deleted. [ 611.878344] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b33702a-61dd-43ee-b8c6-17e6e0f16862" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.117039] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fe43e864-555f-4ea5-8841-d2bcacb15ecc',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.274874] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.275049] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.275203] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.275457] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.275457] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.275695] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 is going to be updated. [ 612.307627] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 40ad5302-74f5-4a10-84dc-42087244e054 [ 612.307868] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.308075] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.308174] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.311047] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.311047] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.311047] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:40ad5302-74f5-4a10-84dc-42087244e054 already deleted. [ 612.311047] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-40ad5302-74f5-4a10-84dc-42087244e054" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.312817] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.312817] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.312817] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.312817] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.312817] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.323115] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 in Status: IN_PROGRESS for 2s [ 612.619010] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.619209] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.620121] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.620121] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.620121] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.620121] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe43e864-555f-4ea5-8841-d2bcacb15ecc is going to be created. [ 612.659027] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.659027] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.659027] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.659027] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.659027] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.680977] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe43e864-555f-4ea5-8841-d2bcacb15ecc in Status: UNINITIALIZED for 2s [ 612.867783] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5704e4e3-8211-4e30-b474-06c668cf060d in Status: SUCCESS [ 612.867783] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.306768] env[62842]: INFO networking_nsxv3.common.synchronization [req-e20920bf-5f84-4abf-a992-b454217aac88 req-702558cf-0283-47c4-a0ea-fd55b1078dcf tempest-FloatingIPsAssociationNegativeTestJSON-318606088 tempest-FloatingIPsAssociationNegativeTestJSON-318606088-project-member] Enqueued Resource ID: 3a92b1e9-7c4f-4a77-a09f-3ba0782fff02 with Priority: HIGHEST for action security_group_members [ 613.306768] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a92b1e9-7c4f-4a77-a09f-3ba0782fff02 with Priority: HIGHEST for action security_group_members [ 613.307108] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a92b1e9-7c4f-4a77-a09f-3ba0782fff02 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.307229] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a92b1e9-7c4f-4a77-a09f-3ba0782fff02" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.307298] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a92b1e9-7c4f-4a77-a09f-3ba0782fff02" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.307558] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a92b1e9-7c4f-4a77-a09f-3ba0782fff02" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.308284] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.308284] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.308284] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.308284] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.308519] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.308519] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a92b1e9-7c4f-4a77-a09f-3ba0782fff02',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.811636] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.811737] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.811790] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.812066] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.815713] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.815713] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.815713] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.815713] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.816573] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.816573] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.817863] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a92b1e9-7c4f-4a77-a09f-3ba0782fff02 already deleted. [ 613.817863] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a92b1e9-7c4f-4a77-a09f-3ba0782fff02" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.011586] env[62842]: INFO networking_nsxv3.common.synchronization [None req-52d699a5-a386-4528-ab2e-56e71a4092f9 None None] Enqueued Resource ID: d4801831-17aa-4e37-902e-f084f24f8d80 with Priority: HIGHEST for action port [ 614.011586] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4801831-17aa-4e37-902e-f084f24f8d80 with Priority: HIGHEST for action port [ 614.013272] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-d4801831-17aa-4e37-902e-f084f24f8d80 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.013272] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d4801831-17aa-4e37-902e-f084f24f8d80" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.013272] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d4801831-17aa-4e37-902e-f084f24f8d80" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.016304] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d4801831-17aa-4e37-902e-f084f24f8d80" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.016304] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4801831-17aa-4e37-902e-f084f24f8d80',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.175308] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-108 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.175308] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-108" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.175308] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-108" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.175308] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-108" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.175308] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.175308] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.175308] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.175308] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.175308] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.175308] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 614.175308] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 614.176960] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 614.176960] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 614.176960] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 614.176960] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 614.176960] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 614.204023] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 614.204357] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 614.204578] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 614.204853] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-108" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.205240] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-df830454-55b6-4485-81a3-cd2c5753c230 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.205457] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-df830454-55b6-4485-81a3-cd2c5753c230" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.205606] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-df830454-55b6-4485-81a3-cd2c5753c230" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.206033] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-df830454-55b6-4485-81a3-cd2c5753c230" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.206213] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df830454-55b6-4485-81a3-cd2c5753c230',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.334546] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 in Status: SUCCESS [ 614.334763] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.334933] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.335206] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.335404] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.335561] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.335561] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.335762] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.335797] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.336211] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.336211] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-331dd47d-e3b4-4338-b588-cd456a9aa5f7 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.336211] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.336211] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.336577] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.336577] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.339597] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.339597] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.339717] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.339806] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.341168] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.341168] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('331dd47d-e3b4-4338-b588-cd456a9aa5f7',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.341168] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.341168] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.341508] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.341508] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.341508] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.341624] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.341999] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.341999] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('331dd47d-e3b4-4338-b588-cd456a9aa5f7',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.518783] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d4801831-17aa-4e37-902e-f084f24f8d80 [ 614.519357] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.519357] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.519357] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.519597] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.519597] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.519708] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d4801831-17aa-4e37-902e-f084f24f8d80 already deleted. [ 614.519708] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d4801831-17aa-4e37-902e-f084f24f8d80" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.691970] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe43e864-555f-4ea5-8841-d2bcacb15ecc in Status: SUCCESS [ 614.692216] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.692386] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.693436] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.693787] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.694264] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.694428] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.694682] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.694855] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.695052] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.695437] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fe43e864-555f-4ea5-8841-d2bcacb15ecc',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.709899] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.710133] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.713174] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.713174] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.713174] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.713174] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port df830454-55b6-4485-81a3-cd2c5753c230 not found, creating... [ 614.713174] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.713174] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.713174] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.713174] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.713174] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.713174] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.713991] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.713991] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.713991] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.713991] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.713991] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: df830454-55b6-4485-81a3-cd2c5753c230 is going to be created. [ 614.745074] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.745282] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.745407] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.745686] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.745916] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.746192] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-df830454-55b6-4485-81a3-cd2c5753c230" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.844027] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 331dd47d-e3b4-4338-b588-cd456a9aa5f7: rpc.has_security_group_logging(os_id): False [ 614.845155] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('331dd47d-e3b4-4338-b588-cd456a9aa5f7',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.881763] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.881763] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.881763] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.881945] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.882124] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.882222] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.882319] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.882729] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.882729] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.882729] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.882876] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.882876] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.882994] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.883119] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.883166] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.883531] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.883531] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.883531] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.883724] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.883724] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.883812] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 is going to be created. [ 614.905487] env[62842]: INFO networking_nsxv3.common.synchronization [None req-8ffed6a3-ef0f-455f-b959-ca0edca99e0b None None] Enqueued Resource ID: ef7a42f1-322b-46ad-94ab-f3cdcf228154 with Priority: HIGHEST for action port [ 614.907282] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef7a42f1-322b-46ad-94ab-f3cdcf228154 with Priority: HIGHEST for action port [ 614.909812] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-ef7a42f1-322b-46ad-94ab-f3cdcf228154 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.910548] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ef7a42f1-322b-46ad-94ab-f3cdcf228154" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.910548] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ef7a42f1-322b-46ad-94ab-f3cdcf228154" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.910548] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ef7a42f1-322b-46ad-94ab-f3cdcf228154" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.910548] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef7a42f1-322b-46ad-94ab-f3cdcf228154',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.969087] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.969273] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.969346] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.969559] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.969736] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.997779] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 in Status: IN_PROGRESS for 2s [ 615.198975] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe43e864-555f-4ea5-8841-d2bcacb15ecc taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.199426] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.199426] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.199508] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.201184] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.201184] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.201184] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.201184] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.201184] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.201184] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.201184] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe43e864-555f-4ea5-8841-d2bcacb15ecc taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.201184] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.201184] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.201184] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.201184] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.201184] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.201184] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.201184] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.201184] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.201184] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.202190] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fe43e864-555f-4ea5-8841-d2bcacb15ecc',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.350449] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('331dd47d-e3b4-4338-b588-cd456a9aa5f7',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.414782] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ef7a42f1-322b-46ad-94ab-f3cdcf228154 [ 615.414782] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.414782] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.414782] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.414782] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.414782] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.414782] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ef7a42f1-322b-46ad-94ab-f3cdcf228154 already deleted. [ 615.414782] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ef7a42f1-322b-46ad-94ab-f3cdcf228154" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.708525] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fe43e864-555f-4ea5-8841-d2bcacb15ecc: rpc.has_security_group_logging(os_id): False [ 615.732717] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.732826] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.732866] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.733121] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.733218] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.733520] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.733520] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.733678] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.733737] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.733883] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.734265] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.734265] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.734265] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.734265] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.734634] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.734634] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.734634] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.734825] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.734825] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.734935] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.734935] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fe43e864-555f-4ea5-8841-d2bcacb15ecc is going to be created. [ 615.815589] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.815589] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.815589] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.815589] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.815767] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.829650] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fe43e864-555f-4ea5-8841-d2bcacb15ecc in Status: IN_PROGRESS for 2s [ 615.857151] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.857151] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.857151] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.857151] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.857151] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.857369] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 is going to be updated. [ 615.936879] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.937044] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.937162] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.938463] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.938463] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.955217] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 in Status: IN_PROGRESS for 2s [ 616.016903] env[62842]: INFO networking_nsxv3.common.synchronization [req-e20920bf-5f84-4abf-a992-b454217aac88 req-4a731081-2091-48ec-8ff1-5f7e28adb52b service nova] Enqueued Resource ID: 3a92b1e9-7c4f-4a77-a09f-3ba0782fff02 with Priority: HIGHEST for action security_group_rules [ 616.017103] env[62842]: INFO networking_nsxv3.common.synchronization [req-e20920bf-5f84-4abf-a992-b454217aac88 req-4a731081-2091-48ec-8ff1-5f7e28adb52b service nova] Enqueued Resource ID: 3a92b1e9-7c4f-4a77-a09f-3ba0782fff02 with Priority: HIGHEST for action security_group_members [ 616.017242] env[62842]: INFO networking_nsxv3.common.synchronization [req-e20920bf-5f84-4abf-a992-b454217aac88 req-4a731081-2091-48ec-8ff1-5f7e28adb52b service nova] Enqueued Resource ID: df830454-55b6-4485-81a3-cd2c5753c230 with Priority: HIGHEST for action port [ 616.017476] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a92b1e9-7c4f-4a77-a09f-3ba0782fff02 with Priority: HIGHEST for action security_group_rules [ 616.017609] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a92b1e9-7c4f-4a77-a09f-3ba0782fff02 with Priority: HIGHEST for action security_group_members [ 616.017720] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df830454-55b6-4485-81a3-cd2c5753c230 with Priority: HIGHEST for action port [ 616.018895] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a92b1e9-7c4f-4a77-a09f-3ba0782fff02 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.018895] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a92b1e9-7c4f-4a77-a09f-3ba0782fff02" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.018895] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a92b1e9-7c4f-4a77-a09f-3ba0782fff02" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.018895] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a92b1e9-7c4f-4a77-a09f-3ba0782fff02" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.019393] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a92b1e9-7c4f-4a77-a09f-3ba0782fff02',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.022282] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a92b1e9-7c4f-4a77-a09f-3ba0782fff02 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.022282] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a92b1e9-7c4f-4a77-a09f-3ba0782fff02" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.022282] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a92b1e9-7c4f-4a77-a09f-3ba0782fff02" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.022282] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a92b1e9-7c4f-4a77-a09f-3ba0782fff02" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.022282] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.022282] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.022282] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.022282] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.022282] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.022834] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a92b1e9-7c4f-4a77-a09f-3ba0782fff02',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.025723] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-df830454-55b6-4485-81a3-cd2c5753c230 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.030222] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df830454-55b6-4485-81a3-cd2c5753c230" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.030222] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df830454-55b6-4485-81a3-cd2c5753c230" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.030222] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df830454-55b6-4485-81a3-cd2c5753c230" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.030222] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df830454-55b6-4485-81a3-cd2c5753c230',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.238399] env[62842]: INFO networking_nsxv3.common.synchronization [None req-3c55fa35-b8dd-4b63-a926-ba442e21bd30 None None] Enqueued Resource ID: 7c7fc048-a2f9-4af2-8544-099d8e6ca7f9 with Priority: HIGHEST for action port [ 616.238727] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c7fc048-a2f9-4af2-8544-099d8e6ca7f9 with Priority: HIGHEST for action port [ 616.239350] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c7fc048-a2f9-4af2-8544-099d8e6ca7f9 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.239466] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c7fc048-a2f9-4af2-8544-099d8e6ca7f9" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.239521] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c7fc048-a2f9-4af2-8544-099d8e6ca7f9" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.240112] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c7fc048-a2f9-4af2-8544-099d8e6ca7f9" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.240112] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c7fc048-a2f9-4af2-8544-099d8e6ca7f9',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.527238] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3a92b1e9-7c4f-4a77-a09f-3ba0782fff02',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.531353] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a92b1e9-7c4f-4a77-a09f-3ba0782fff02 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.531353] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a92b1e9-7c4f-4a77-a09f-3ba0782fff02" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.531353] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port df830454-55b6-4485-81a3-cd2c5753c230 with status ACTIVE [ 616.531353] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.531353] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.531353] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.531353] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.531353] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.531941] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.531941] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.531941] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.531941] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.531941] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.532287] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.532287] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.532287] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.532287] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.532504] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.532504] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: df830454-55b6-4485-81a3-cd2c5753c230 is going to be updated. [ 616.565257] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.565416] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.565459] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.565657] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.565787] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.565965] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df830454-55b6-4485-81a3-cd2c5753c230" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.742682] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7c7fc048-a2f9-4af2-8544-099d8e6ca7f9 [ 616.742867] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.743084] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.743084] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.743288] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.743358] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.743492] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7c7fc048-a2f9-4af2-8544-099d8e6ca7f9 already deleted. [ 616.743559] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c7fc048-a2f9-4af2-8544-099d8e6ca7f9" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.796124] env[62842]: INFO networking_nsxv3.common.synchronization [None req-4e19828b-dad6-431c-b1c6-76e2d35767f1 None None] Enqueued Resource ID: 12507ab2-c3c0-401a-a20a-d7e04f96d244 with Priority: HIGHEST for action port [ 616.800033] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12507ab2-c3c0-401a-a20a-d7e04f96d244 with Priority: HIGHEST for action port [ 616.800033] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-12507ab2-c3c0-401a-a20a-d7e04f96d244 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.800033] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12507ab2-c3c0-401a-a20a-d7e04f96d244" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.800033] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12507ab2-c3c0-401a-a20a-d7e04f96d244" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.800584] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12507ab2-c3c0-401a-a20a-d7e04f96d244" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.800584] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12507ab2-c3c0-401a-a20a-d7e04f96d244',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.017367] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 in Status: SUCCESS [ 617.017600] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.017789] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.018025] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.018242] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('331dd47d-e3b4-4338-b588-cd456a9aa5f7',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.030407] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3a92b1e9-7c4f-4a77-a09f-3ba0782fff02',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.303362] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 12507ab2-c3c0-401a-a20a-d7e04f96d244 [ 617.303667] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.303741] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.303784] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.306027] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.306027] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.306027] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:12507ab2-c3c0-401a-a20a-d7e04f96d244 already deleted. [ 617.306027] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12507ab2-c3c0-401a-a20a-d7e04f96d244" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.503311] env[62842]: INFO networking_nsxv3.common.synchronization [req-c839d569-4f4f-418b-a0ae-cd68093ba1dc req-722047b0-ccef-4ee6-83a7-a99c2d140e9d tempest-ServerActionsTestOtherA-1611322165 tempest-ServerActionsTestOtherA-1611322165-project-member] Enqueued Resource ID: 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 with Priority: HIGHEST for action security_group_members [ 617.503311] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 with Priority: HIGHEST for action security_group_members [ 617.503311] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.503311] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.503311] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.503735] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.503735] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.503911] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.503911] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.504065] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.508264] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.508429] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.521080] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-331dd47d-e3b4-4338-b588-cd456a9aa5f7 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.521080] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.535901] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.536087] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.536332] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.536392] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.536654] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.536654] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a92b1e9-7c4f-4a77-a09f-3ba0782fff02 is going to be created. [ 617.568822] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.569057] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.569119] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.569315] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.569487] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.580780] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a92b1e9-7c4f-4a77-a09f-3ba0782fff02 in Status: UNINITIALIZED for 2s [ 617.845682] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fe43e864-555f-4ea5-8841-d2bcacb15ecc in Status: SUCCESS [ 617.845980] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.970267] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 in Status: SUCCESS [ 617.970459] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.970950] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.970950] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.971628] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.972066] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.972202] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.973317] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.973317] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.973317] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.973317] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('331dd47d-e3b4-4338-b588-cd456a9aa5f7',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.013146] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.014135] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.014284] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.014460] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.014566] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.014789] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.014896] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.014958] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.015139] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.015216] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.015305] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 already deleted. [ 618.015395] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.314674] env[62842]: INFO networking_nsxv3.common.synchronization [None req-41b2efdb-7d6f-43cd-bea9-17e1fc5b102c tempest-ServersTestJSON-1961539448 tempest-ServersTestJSON-1961539448-project-member] Enqueued Resource ID: 2d753783-8988-4639-a0fc-596bf03e413b with Priority: HIGHEST for action security_group_rules [ 618.315361] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d753783-8988-4639-a0fc-596bf03e413b with Priority: HIGHEST for action security_group_rules [ 618.315797] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d753783-8988-4639-a0fc-596bf03e413b taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.315946] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d753783-8988-4639-a0fc-596bf03e413b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.315946] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d753783-8988-4639-a0fc-596bf03e413b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.316295] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d753783-8988-4639-a0fc-596bf03e413b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.316435] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d753783-8988-4639-a0fc-596bf03e413b',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.439152] env[62842]: INFO networking_nsxv3.common.synchronization [None req-32173fc7-c254-4eb5-897d-31d914462a59 tempest-ServersTestJSON-1961539448 tempest-ServersTestJSON-1961539448-project-member] Enqueued Resource ID: 2d753783-8988-4639-a0fc-596bf03e413b with Priority: HIGHEST for action security_group_rules [ 618.439908] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d753783-8988-4639-a0fc-596bf03e413b with Priority: HIGHEST for action security_group_rules [ 618.441113] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d753783-8988-4639-a0fc-596bf03e413b taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.441251] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d753783-8988-4639-a0fc-596bf03e413b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.476684] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-331dd47d-e3b4-4338-b588-cd456a9aa5f7 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.476917] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.476981] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.477219] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.477412] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.477531] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.477592] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.477786] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.477885] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.478037] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.478221] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-331dd47d-e3b4-4338-b588-cd456a9aa5f7 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.478346] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.478422] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.478620] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.478817] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.478894] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.478997] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.479111] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.479199] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.479286] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.479381] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('331dd47d-e3b4-4338-b588-cd456a9aa5f7',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.675772] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-8 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.675930] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.675976] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.676473] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.676839] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.677088] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.677258] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.677709] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.678389] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.678665] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 618.678890] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 618.679052] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 618.679195] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 618.679314] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 618.679419] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 618.679619] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 618.704404] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 618.704761] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 618.704946] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 618.705250] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.705680] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-36bcc073-d970-4b5c-9e69-c54d76d347d5 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.706036] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-36bcc073-d970-4b5c-9e69-c54d76d347d5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.706630] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-36bcc073-d970-4b5c-9e69-c54d76d347d5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.708633] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-36bcc073-d970-4b5c-9e69-c54d76d347d5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.708633] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36bcc073-d970-4b5c-9e69-c54d76d347d5',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.845014] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.845379] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.845379] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.845711] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.845862] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.846013] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d753783-8988-4639-a0fc-596bf03e413b already deleted. [ 618.846135] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d753783-8988-4639-a0fc-596bf03e413b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.846294] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d753783-8988-4639-a0fc-596bf03e413b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.846465] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d753783-8988-4639-a0fc-596bf03e413b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.846558] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d753783-8988-4639-a0fc-596bf03e413b',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.892768] env[62842]: INFO networking_nsxv3.common.synchronization [None req-6deb05e2-88a6-40c7-a741-dc3bd0c9fecf None None] Enqueued Resource ID: 12e855f3-067e-4974-bee5-ce99f4718806 with Priority: HIGHEST for action port [ 618.893545] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12e855f3-067e-4974-bee5-ce99f4718806 with Priority: HIGHEST for action port [ 618.894509] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-12e855f3-067e-4974-bee5-ce99f4718806 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.894509] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12e855f3-067e-4974-bee5-ce99f4718806" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.896285] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12e855f3-067e-4974-bee5-ce99f4718806" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.896285] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12e855f3-067e-4974-bee5-ce99f4718806" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.896285] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12e855f3-067e-4974-bee5-ce99f4718806',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.981501] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 331dd47d-e3b4-4338-b588-cd456a9aa5f7: rpc.has_security_group_logging(os_id): False [ 619.003252] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.003506] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.004548] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.004548] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.004548] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.004548] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.004548] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.004548] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.004548] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.005096] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.005096] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.005096] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.009129] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.009129] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.009129] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.009129] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.009129] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.009129] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.009129] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.009129] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.009129] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 is going to be updated. [ 619.112056] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.112196] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.112262] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.112613] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.112836] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.131603] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 in Status: IN_PROGRESS for 2s [ 619.213085] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.213332] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.213394] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.213700] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.213962] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.214177] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 36bcc073-d970-4b5c-9e69-c54d76d347d5 not found, creating... [ 619.214568] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.214761] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.214867] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.215145] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.215293] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.215598] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.215758] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.216508] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.216508] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.216648] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.217299] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 36bcc073-d970-4b5c-9e69-c54d76d347d5 is going to be created. [ 619.247015] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.247015] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.247015] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.247015] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.247015] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.247015] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-36bcc073-d970-4b5c-9e69-c54d76d347d5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.374599] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.374599] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.374961] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.374961] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.375214] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.375214] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d753783-8988-4639-a0fc-596bf03e413b already deleted. [ 619.375427] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d753783-8988-4639-a0fc-596bf03e413b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.401140] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 12e855f3-067e-4974-bee5-ce99f4718806 [ 619.403183] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.403183] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.403183] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.403183] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.403451] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.403451] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:12e855f3-067e-4974-bee5-ce99f4718806 already deleted. [ 619.403451] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12e855f3-067e-4974-bee5-ce99f4718806" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.594022] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a92b1e9-7c4f-4a77-a09f-3ba0782fff02 in Status: SUCCESS [ 619.594022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a92b1e9-7c4f-4a77-a09f-3ba0782fff02" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.594022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a92b1e9-7c4f-4a77-a09f-3ba0782fff02" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.594022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a92b1e9-7c4f-4a77-a09f-3ba0782fff02" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.595320] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.595500] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.595557] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.595725] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.595814] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.596039] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a92b1e9-7c4f-4a77-a09f-3ba0782fff02" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.596039] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3a92b1e9-7c4f-4a77-a09f-3ba0782fff02',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.810024] env[62842]: INFO networking_nsxv3.common.synchronization [req-56e242ce-5623-4b1b-b02d-373813123896 req-0d6e521e-463f-4fd8-8578-1553b90c28a8 tempest-VolumesAdminNegativeTest-1647971171 tempest-VolumesAdminNegativeTest-1647971171-project-member] Enqueued Resource ID: 38065a18-23d4-472c-902b-3e37fa7fb4aa with Priority: HIGHEST for action security_group_members [ 619.810593] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38065a18-23d4-472c-902b-3e37fa7fb4aa with Priority: HIGHEST for action security_group_members [ 619.810896] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-38065a18-23d4-472c-902b-3e37fa7fb4aa taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.811609] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38065a18-23d4-472c-902b-3e37fa7fb4aa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.811783] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38065a18-23d4-472c-902b-3e37fa7fb4aa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.811996] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38065a18-23d4-472c-902b-3e37fa7fb4aa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.812168] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.812270] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.812330] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.812473] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.812558] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.812648] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38065a18-23d4-472c-902b-3e37fa7fb4aa',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.099990] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a92b1e9-7c4f-4a77-a09f-3ba0782fff02 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.099990] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a92b1e9-7c4f-4a77-a09f-3ba0782fff02" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.099990] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a92b1e9-7c4f-4a77-a09f-3ba0782fff02" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.099990] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a92b1e9-7c4f-4a77-a09f-3ba0782fff02" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.099990] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.099990] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.099990] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.099990] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.100724] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.100724] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a92b1e9-7c4f-4a77-a09f-3ba0782fff02" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.100724] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a92b1e9-7c4f-4a77-a09f-3ba0782fff02 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.100724] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a92b1e9-7c4f-4a77-a09f-3ba0782fff02" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.100724] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a92b1e9-7c4f-4a77-a09f-3ba0782fff02" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.100724] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a92b1e9-7c4f-4a77-a09f-3ba0782fff02" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.100724] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.101344] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.101344] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.101344] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.101344] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.101344] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a92b1e9-7c4f-4a77-a09f-3ba0782fff02" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.101344] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3a92b1e9-7c4f-4a77-a09f-3ba0782fff02',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.232889] env[62842]: INFO networking_nsxv3.common.synchronization [None req-4bb535a9-02df-41cf-96dd-d8a0dbb3ec74 None None] Enqueued Resource ID: 211a8e00-d297-4ca0-a286-b1932ec2b39a with Priority: HIGHEST for action port [ 620.234731] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 211a8e00-d297-4ca0-a286-b1932ec2b39a with Priority: HIGHEST for action port [ 620.235474] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-211a8e00-d297-4ca0-a286-b1932ec2b39a taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.235610] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-211a8e00-d297-4ca0-a286-b1932ec2b39a" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.235677] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-211a8e00-d297-4ca0-a286-b1932ec2b39a" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.235967] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-211a8e00-d297-4ca0-a286-b1932ec2b39a" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.236337] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('211a8e00-d297-4ca0-a286-b1932ec2b39a',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.315683] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.318444] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.318444] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.318444] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.318444] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.318444] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.318444] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.318444] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.318444] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.318444] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.318444] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38065a18-23d4-472c-902b-3e37fa7fb4aa is going to be updated. [ 620.352362] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.352451] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.352488] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.353654] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.353654] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.365960] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38065a18-23d4-472c-902b-3e37fa7fb4aa in Status: IN_PROGRESS for 2s [ 620.604533] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3a92b1e9-7c4f-4a77-a09f-3ba0782fff02: rpc.has_security_group_logging(os_id): False [ 620.620304] env[62842]: INFO networking_nsxv3.common.synchronization [req-c839d569-4f4f-418b-a0ae-cd68093ba1dc req-c75b281f-e040-40be-9500-765af4948717 service nova] Enqueued Resource ID: 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 with Priority: HIGHEST for action security_group_rules [ 620.620943] env[62842]: INFO networking_nsxv3.common.synchronization [req-c839d569-4f4f-418b-a0ae-cd68093ba1dc req-c75b281f-e040-40be-9500-765af4948717 service nova] Enqueued Resource ID: 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 with Priority: HIGHEST for action security_group_members [ 620.620943] env[62842]: INFO networking_nsxv3.common.synchronization [req-c839d569-4f4f-418b-a0ae-cd68093ba1dc req-c75b281f-e040-40be-9500-765af4948717 service nova] Enqueued Resource ID: 36bcc073-d970-4b5c-9e69-c54d76d347d5 with Priority: HIGHEST for action port [ 620.621378] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 with Priority: HIGHEST for action security_group_rules [ 620.621818] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 with Priority: HIGHEST for action security_group_members [ 620.621977] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36bcc073-d970-4b5c-9e69-c54d76d347d5 with Priority: HIGHEST for action port [ 620.622330] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.622538] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.622578] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.623650] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.623650] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.623966] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.624152] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.624258] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.624520] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.624774] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.624862] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.624921] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.625107] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.625198] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.625291] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.626460] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-36bcc073-d970-4b5c-9e69-c54d76d347d5 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.626573] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-36bcc073-d970-4b5c-9e69-c54d76d347d5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.626637] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-36bcc073-d970-4b5c-9e69-c54d76d347d5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.626796] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-36bcc073-d970-4b5c-9e69-c54d76d347d5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.626912] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36bcc073-d970-4b5c-9e69-c54d76d347d5',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.628684] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.628740] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.628826] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.629054] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.629174] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.629372] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.629495] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.630319] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.630969] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.631426] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.632233] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.632328] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.632607] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.632731] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.632831] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.634017] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.634017] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.634017] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.634017] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.634017] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.634017] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a92b1e9-7c4f-4a77-a09f-3ba0782fff02 is going to be created. [ 620.700417] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.700564] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.700631] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.700853] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.701052] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.712739] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a92b1e9-7c4f-4a77-a09f-3ba0782fff02 in Status: IN_PROGRESS for 2s [ 620.738124] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 211a8e00-d297-4ca0-a286-b1932ec2b39a [ 620.738490] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.738490] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.738609] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.738766] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.738854] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.738957] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:211a8e00-d297-4ca0-a286-b1932ec2b39a already deleted. [ 620.739087] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-211a8e00-d297-4ca0-a286-b1932ec2b39a" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.128847] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.128847] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.129233] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.136721] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 36bcc073-d970-4b5c-9e69-c54d76d347d5 with status ACTIVE [ 621.137203] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.137203] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.137203] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.137475] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.137475] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.137807] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.137920] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.137999] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.138254] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.138336] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.138562] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.138663] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.138804] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.138949] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.139071] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.139193] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 36bcc073-d970-4b5c-9e69-c54d76d347d5 is going to be updated. [ 621.148078] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 in Status: SUCCESS [ 621.148394] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.148551] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.148757] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.148858] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('331dd47d-e3b4-4338-b588-cd456a9aa5f7',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.167888] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.168126] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.168186] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.168402] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.168563] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.168721] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-36bcc073-d970-4b5c-9e69-c54d76d347d5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.634999] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.654692] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-331dd47d-e3b4-4338-b588-cd456a9aa5f7 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.654830] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.654897] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.655128] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.655287] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.655386] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.655446] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.655599] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.655701] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.655788] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.655874] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('331dd47d-e3b4-4338-b588-cd456a9aa5f7',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.141036] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.141036] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.141036] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.141308] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.141448] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.141506] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 is going to be created. [ 622.162572] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-331dd47d-e3b4-4338-b588-cd456a9aa5f7 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.163253] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.163253] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.163253] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.163433] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.163496] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.163538] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.163716] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.163822] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.163934] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.164142] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-331dd47d-e3b4-4338-b588-cd456a9aa5f7 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.164247] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.164304] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.164494] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.164639] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.164733] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.164809] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.164952] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.165242] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.165242] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.165352] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('331dd47d-e3b4-4338-b588-cd456a9aa5f7',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.174717] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.174866] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.174940] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.175225] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.175396] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.187462] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 in Status: UNINITIALIZED for 2s [ 622.376886] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38065a18-23d4-472c-902b-3e37fa7fb4aa in Status: SUCCESS [ 622.376999] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38065a18-23d4-472c-902b-3e37fa7fb4aa deletion is rescheduled due to dependency. [ 622.377167] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38065a18-23d4-472c-902b-3e37fa7fb4aa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.670160] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 331dd47d-e3b4-4338-b588-cd456a9aa5f7: rpc.has_security_group_logging(os_id): False [ 622.691333] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.691333] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.691333] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.691333] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.691333] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.691333] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.691333] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.691333] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.691333] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.691333] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.691333] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.691333] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.691829] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.691829] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.691829] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.691829] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.691967] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.691967] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.692206] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.692313] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.692425] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 is going to be updated. [ 622.734573] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a92b1e9-7c4f-4a77-a09f-3ba0782fff02 in Status: SUCCESS [ 622.737775] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a92b1e9-7c4f-4a77-a09f-3ba0782fff02" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.804396] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.804607] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.804713] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.804832] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.804977] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.840481] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 in Status: IN_PROGRESS for 2s [ 623.797542] env[62842]: INFO networking_nsxv3.common.synchronization [None req-0f42c8e6-4bdf-47e1-9d1a-289512be2536 None None] Enqueued Resource ID: df516d26-fe3e-4779-98de-d6d9377f2ba7 with Priority: HIGHEST for action port [ 623.797933] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df516d26-fe3e-4779-98de-d6d9377f2ba7 with Priority: HIGHEST for action port [ 623.798476] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-df516d26-fe3e-4779-98de-d6d9377f2ba7 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.798623] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df516d26-fe3e-4779-98de-d6d9377f2ba7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.798683] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df516d26-fe3e-4779-98de-d6d9377f2ba7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.798932] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df516d26-fe3e-4779-98de-d6d9377f2ba7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.799029] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df516d26-fe3e-4779-98de-d6d9377f2ba7',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.199715] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 in Status: SUCCESS [ 624.199778] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.199937] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.200188] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.200715] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.200715] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.200715] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.201976] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.202097] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.202994] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.202994] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.301162] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port df516d26-fe3e-4779-98de-d6d9377f2ba7 [ 624.301411] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.301969] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.302510] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.302510] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.302510] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.302510] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:df516d26-fe3e-4779-98de-d6d9377f2ba7 already deleted. [ 624.302510] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df516d26-fe3e-4779-98de-d6d9377f2ba7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.616443] env[62842]: INFO networking_nsxv3.common.synchronization [req-663cff1a-b730-41e7-a5bc-04ecf79c43ad req-9e83d059-c54b-47ef-8bb5-c735b9ba3c4f tempest-ListImageFiltersTestJSON-20601446 tempest-ListImageFiltersTestJSON-20601446-project-member] Enqueued Resource ID: fe43e864-555f-4ea5-8841-d2bcacb15ecc with Priority: HIGHEST for action security_group_members [ 624.618516] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe43e864-555f-4ea5-8841-d2bcacb15ecc with Priority: HIGHEST for action security_group_members [ 624.618858] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe43e864-555f-4ea5-8841-d2bcacb15ecc taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.619055] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.619055] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.619287] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.619447] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.619549] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.619608] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.619749] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.619833] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.619925] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe43e864-555f-4ea5-8841-d2bcacb15ecc',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.707964] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.855880] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 in Status: SUCCESS [ 624.856651] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.121898] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fe43e864-555f-4ea5-8841-d2bcacb15ecc',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.210767] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393: rpc.has_security_group_logging(os_id): False [ 625.233368] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.233368] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.233368] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.233368] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.233368] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.233368] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.233368] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.233368] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.233368] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.233368] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.233368] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 is going to be created. [ 625.302548] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.302733] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.302814] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.303060] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.303339] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.323298] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 in Status: IN_PROGRESS for 2s [ 625.588020] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-938 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.588020] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-938" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.588020] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-938" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.588020] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-938" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.588020] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.588020] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.588020] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.588618] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.589098] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.589098] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 625.589098] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 625.589354] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 625.589354] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 625.590198] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 625.590198] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 625.590198] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 625.612397] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 625.612589] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 625.614020] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 625.614020] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-938" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.614020] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-cda15097-eea4-464d-b980-ad455aaf6b76 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.614020] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-cda15097-eea4-464d-b980-ad455aaf6b76" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.614020] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-cda15097-eea4-464d-b980-ad455aaf6b76" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.614020] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-cda15097-eea4-464d-b980-ad455aaf6b76" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.614613] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cda15097-eea4-464d-b980-ad455aaf6b76',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.625892] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fe43e864-555f-4ea5-8841-d2bcacb15ecc',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.117232] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.117680] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.118937] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.119233] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.119414] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.119584] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port cda15097-eea4-464d-b980-ad455aaf6b76 not found, creating... [ 626.119878] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.120097] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.120227] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.120488] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.120652] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.120963] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.122369] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.122549] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.122827] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.123054] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.123268] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: cda15097-eea4-464d-b980-ad455aaf6b76 is going to be created. [ 626.127924] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.129763] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.129763] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.129763] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.129763] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.129763] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe43e864-555f-4ea5-8841-d2bcacb15ecc is going to be updated. [ 626.158053] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.159582] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.159582] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.159582] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.159582] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.159582] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-cda15097-eea4-464d-b980-ad455aaf6b76" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.174056] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.174056] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.174056] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.174056] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.174056] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.185429] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe43e864-555f-4ea5-8841-d2bcacb15ecc in Status: IN_PROGRESS for 2s [ 626.410259] env[62842]: INFO networking_nsxv3.common.synchronization [None req-44014996-d690-4377-978a-1a9e4b78f999 None None] Enqueued Resource ID: 71633f71-0a25-4e30-988b-84126833873b with Priority: HIGHEST for action port [ 626.410531] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71633f71-0a25-4e30-988b-84126833873b with Priority: HIGHEST for action port [ 626.413689] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-71633f71-0a25-4e30-988b-84126833873b taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.413689] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71633f71-0a25-4e30-988b-84126833873b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.413689] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71633f71-0a25-4e30-988b-84126833873b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.413689] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71633f71-0a25-4e30-988b-84126833873b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.413689] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71633f71-0a25-4e30-988b-84126833873b',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.916077] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 71633f71-0a25-4e30-988b-84126833873b [ 626.916324] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.916475] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.916696] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.916774] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.916937] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.916937] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:71633f71-0a25-4e30-988b-84126833873b already deleted. [ 626.917094] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71633f71-0a25-4e30-988b-84126833873b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.196248] env[62842]: INFO networking_nsxv3.common.synchronization [req-663cff1a-b730-41e7-a5bc-04ecf79c43ad req-2bd13097-fb26-4fd0-97b5-551041bd501c service nova] Enqueued Resource ID: fe43e864-555f-4ea5-8841-d2bcacb15ecc with Priority: HIGHEST for action security_group_rules [ 627.196616] env[62842]: INFO networking_nsxv3.common.synchronization [req-663cff1a-b730-41e7-a5bc-04ecf79c43ad req-2bd13097-fb26-4fd0-97b5-551041bd501c service nova] Enqueued Resource ID: fe43e864-555f-4ea5-8841-d2bcacb15ecc with Priority: HIGHEST for action security_group_members [ 627.196616] env[62842]: INFO networking_nsxv3.common.synchronization [req-663cff1a-b730-41e7-a5bc-04ecf79c43ad req-2bd13097-fb26-4fd0-97b5-551041bd501c service nova] Enqueued Resource ID: cda15097-eea4-464d-b980-ad455aaf6b76 with Priority: HIGHEST for action port [ 627.196838] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe43e864-555f-4ea5-8841-d2bcacb15ecc with Priority: HIGHEST for action security_group_rules [ 627.197012] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe43e864-555f-4ea5-8841-d2bcacb15ecc with Priority: HIGHEST for action security_group_members [ 627.197090] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cda15097-eea4-464d-b980-ad455aaf6b76 with Priority: HIGHEST for action port [ 627.197701] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fe43e864-555f-4ea5-8841-d2bcacb15ecc taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.197839] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.197903] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.199670] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.199670] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fe43e864-555f-4ea5-8841-d2bcacb15ecc',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.200200] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe43e864-555f-4ea5-8841-d2bcacb15ecc taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.200295] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.200493] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-cda15097-eea4-464d-b980-ad455aaf6b76 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.200598] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cda15097-eea4-464d-b980-ad455aaf6b76" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.200659] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cda15097-eea4-464d-b980-ad455aaf6b76" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.200883] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cda15097-eea4-464d-b980-ad455aaf6b76" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.200946] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cda15097-eea4-464d-b980-ad455aaf6b76',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.338220] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 in Status: SUCCESS [ 627.338478] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.375442] env[62842]: INFO networking_nsxv3.common.synchronization [req-0ae8ba3d-0c94-41e5-b25b-77d7d3b8f359 req-e1c36597-08c3-4649-88cc-5cfe85d25ad1 tempest-VolumesAssistedSnapshotsTest-756271320 tempest-VolumesAssistedSnapshotsTest-756271320-project-member] Enqueued Resource ID: 92cba5b3-76df-405c-acab-0f3155ce22e5 with Priority: HIGHEST for action security_group_members [ 627.375668] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92cba5b3-76df-405c-acab-0f3155ce22e5 with Priority: HIGHEST for action security_group_members [ 627.375993] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-92cba5b3-76df-405c-acab-0f3155ce22e5 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.376134] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92cba5b3-76df-405c-acab-0f3155ce22e5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.376192] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92cba5b3-76df-405c-acab-0f3155ce22e5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.376463] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92cba5b3-76df-405c-acab-0f3155ce22e5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.376626] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.376736] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.376792] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.376981] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.377317] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.377501] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92cba5b3-76df-405c-acab-0f3155ce22e5',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.702362] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe43e864-555f-4ea5-8841-d2bcacb15ecc taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.702483] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.702703] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cda15097-eea4-464d-b980-ad455aaf6b76 with status ACTIVE [ 627.702870] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.702976] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.703083] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.703297] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.703392] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.703578] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.703675] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.703724] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.703866] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.703953] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.704151] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.704248] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.704299] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.704426] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.704497] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.704577] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cda15097-eea4-464d-b980-ad455aaf6b76 is going to be updated. [ 627.727921] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.728074] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.728164] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.728384] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.728520] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.728683] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cda15097-eea4-464d-b980-ad455aaf6b76" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.881216] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.881443] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.881910] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.881910] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.882059] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.882911] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.882911] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.882911] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.882911] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.882911] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.883780] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92cba5b3-76df-405c-acab-0f3155ce22e5 already deleted. [ 627.883947] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92cba5b3-76df-405c-acab-0f3155ce22e5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.892543] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-384 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.892743] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-384" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.892977] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-384" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.893343] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-384" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.893613] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.893770] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.893886] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.894113] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.894265] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.894465] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 627.894579] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 627.894688] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 627.894794] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 627.894902] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 627.895036] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 627.895194] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 627.916927] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 627.916927] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 627.916927] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 627.917229] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-384" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.917599] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-075c31e7-6ceb-4cb5-a5d3-3bce7e6e1f63 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.917783] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-075c31e7-6ceb-4cb5-a5d3-3bce7e6e1f63" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.917902] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-075c31e7-6ceb-4cb5-a5d3-3bce7e6e1f63" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.918374] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-075c31e7-6ceb-4cb5-a5d3-3bce7e6e1f63" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.918509] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('075c31e7-6ceb-4cb5-a5d3-3bce7e6e1f63',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.201035] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe43e864-555f-4ea5-8841-d2bcacb15ecc in Status: SUCCESS [ 628.201326] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.201448] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.201664] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.201856] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.201973] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.202128] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.202292] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.202379] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.202541] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe43e864-555f-4ea5-8841-d2bcacb15ecc',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.421621] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.421916] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.422081] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.422433] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.422591] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.423123] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 075c31e7-6ceb-4cb5-a5d3-3bce7e6e1f63 not found, creating... [ 628.423123] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.423345] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.423385] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.423677] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.423848] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.424977] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.425906] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.425906] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.425906] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.425906] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.426132] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 075c31e7-6ceb-4cb5-a5d3-3bce7e6e1f63 is going to be created. [ 628.455273] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.456286] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.456286] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.456286] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.456286] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.456602] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-075c31e7-6ceb-4cb5-a5d3-3bce7e6e1f63" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.704798] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fe43e864-555f-4ea5-8841-d2bcacb15ecc',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.210304] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fe43e864-555f-4ea5-8841-d2bcacb15ecc',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.359260] env[62842]: INFO networking_nsxv3.common.synchronization [req-0ae8ba3d-0c94-41e5-b25b-77d7d3b8f359 req-1a9c48b4-feed-4e4d-8159-abd65ad6ce2f service nova] Enqueued Resource ID: 92cba5b3-76df-405c-acab-0f3155ce22e5 with Priority: HIGHEST for action security_group_rules [ 629.359542] env[62842]: INFO networking_nsxv3.common.synchronization [req-0ae8ba3d-0c94-41e5-b25b-77d7d3b8f359 req-1a9c48b4-feed-4e4d-8159-abd65ad6ce2f service nova] Enqueued Resource ID: 92cba5b3-76df-405c-acab-0f3155ce22e5 with Priority: HIGHEST for action security_group_members [ 629.359757] env[62842]: INFO networking_nsxv3.common.synchronization [req-0ae8ba3d-0c94-41e5-b25b-77d7d3b8f359 req-1a9c48b4-feed-4e4d-8159-abd65ad6ce2f service nova] Enqueued Resource ID: 075c31e7-6ceb-4cb5-a5d3-3bce7e6e1f63 with Priority: HIGHEST for action port [ 629.360572] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92cba5b3-76df-405c-acab-0f3155ce22e5 with Priority: HIGHEST for action security_group_rules [ 629.360750] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92cba5b3-76df-405c-acab-0f3155ce22e5 with Priority: HIGHEST for action security_group_members [ 629.360890] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 075c31e7-6ceb-4cb5-a5d3-3bce7e6e1f63 with Priority: HIGHEST for action port [ 629.361194] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-92cba5b3-76df-405c-acab-0f3155ce22e5 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.361583] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-92cba5b3-76df-405c-acab-0f3155ce22e5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.361583] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-92cba5b3-76df-405c-acab-0f3155ce22e5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.361583] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-92cba5b3-76df-405c-acab-0f3155ce22e5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.361748] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('92cba5b3-76df-405c-acab-0f3155ce22e5',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.362977] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-92cba5b3-76df-405c-acab-0f3155ce22e5 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.362977] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92cba5b3-76df-405c-acab-0f3155ce22e5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.362977] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92cba5b3-76df-405c-acab-0f3155ce22e5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.363216] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92cba5b3-76df-405c-acab-0f3155ce22e5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.363253] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.363479] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.363552] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.363697] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.363814] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.363945] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92cba5b3-76df-405c-acab-0f3155ce22e5',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.364942] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-075c31e7-6ceb-4cb5-a5d3-3bce7e6e1f63 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.364942] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-075c31e7-6ceb-4cb5-a5d3-3bce7e6e1f63" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.365070] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-075c31e7-6ceb-4cb5-a5d3-3bce7e6e1f63" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.365166] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-075c31e7-6ceb-4cb5-a5d3-3bce7e6e1f63" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.365299] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('075c31e7-6ceb-4cb5-a5d3-3bce7e6e1f63',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.714202] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.714438] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.714438] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.714661] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.714756] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.714856] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe43e864-555f-4ea5-8841-d2bcacb15ecc is going to be updated. [ 629.751741] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.751938] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.752047] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.752308] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.752491] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.763385] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe43e864-555f-4ea5-8841-d2bcacb15ecc in Status: IN_PROGRESS for 2s [ 629.866999] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-92cba5b3-76df-405c-acab-0f3155ce22e5 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.867502] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92cba5b3-76df-405c-acab-0f3155ce22e5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.867834] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('92cba5b3-76df-405c-acab-0f3155ce22e5',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.869027] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 075c31e7-6ceb-4cb5-a5d3-3bce7e6e1f63 with status ACTIVE [ 629.869412] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.870405] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.870405] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.870659] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.871216] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.871216] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.871572] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.871815] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.872297] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.872297] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.873425] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.873425] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.873425] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.873425] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.873425] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.873425] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 075c31e7-6ceb-4cb5-a5d3-3bce7e6e1f63 is going to be updated. [ 629.909177] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.909177] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.909177] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.909177] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.909177] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.909177] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-075c31e7-6ceb-4cb5-a5d3-3bce7e6e1f63" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.378575] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('92cba5b3-76df-405c-acab-0f3155ce22e5',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.434021] env[62842]: INFO networking_nsxv3.common.synchronization [None req-218bdbcf-f31f-489a-8f96-357f0820e8fd None None] Enqueued Resource ID: 6ddf5f32-0741-402e-a20b-1cc47cbf8c5d with Priority: HIGHEST for action port [ 630.434021] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ddf5f32-0741-402e-a20b-1cc47cbf8c5d with Priority: HIGHEST for action port [ 630.434021] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ddf5f32-0741-402e-a20b-1cc47cbf8c5d taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.434870] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ddf5f32-0741-402e-a20b-1cc47cbf8c5d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.435044] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ddf5f32-0741-402e-a20b-1cc47cbf8c5d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.435418] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ddf5f32-0741-402e-a20b-1cc47cbf8c5d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.435742] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ddf5f32-0741-402e-a20b-1cc47cbf8c5d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.882719] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.882719] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.882719] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.882719] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.882719] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.882719] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92cba5b3-76df-405c-acab-0f3155ce22e5 is going to be created. [ 630.911024] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.911024] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.911024] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.911024] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.911377] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.922010] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92cba5b3-76df-405c-acab-0f3155ce22e5 in Status: UNINITIALIZED for 2s [ 630.938650] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6ddf5f32-0741-402e-a20b-1cc47cbf8c5d [ 630.938881] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.939029] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.939098] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.943021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.943021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.943021] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6ddf5f32-0741-402e-a20b-1cc47cbf8c5d already deleted. [ 630.943021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ddf5f32-0741-402e-a20b-1cc47cbf8c5d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.783697] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe43e864-555f-4ea5-8841-d2bcacb15ecc in Status: SUCCESS [ 631.783697] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.783697] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.783697] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.783697] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.783697] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.783697] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.783697] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.783697] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.783697] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.783697] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fe43e864-555f-4ea5-8841-d2bcacb15ecc',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.286259] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe43e864-555f-4ea5-8841-d2bcacb15ecc taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.290763] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.290763] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.290763] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.290763] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.290763] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.290763] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.290763] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.290763] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.290763] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.290763] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe43e864-555f-4ea5-8841-d2bcacb15ecc taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.290763] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.290763] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.290763] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.290763] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.290763] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.290763] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.290763] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.290763] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.291915] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.291915] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fe43e864-555f-4ea5-8841-d2bcacb15ecc',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.700719] env[62842]: INFO networking_nsxv3.common.synchronization [None req-d52ac2cf-41a8-4447-9e23-6890e2fdf082 None None] Enqueued Resource ID: 0c8b18c6-dfed-4391-85cd-455fbb35b6cd with Priority: HIGHEST for action port [ 632.701956] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c8b18c6-dfed-4391-85cd-455fbb35b6cd with Priority: HIGHEST for action port [ 632.701956] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-0c8b18c6-dfed-4391-85cd-455fbb35b6cd taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.702219] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0c8b18c6-dfed-4391-85cd-455fbb35b6cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.702358] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0c8b18c6-dfed-4391-85cd-455fbb35b6cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.703700] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0c8b18c6-dfed-4391-85cd-455fbb35b6cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.703817] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c8b18c6-dfed-4391-85cd-455fbb35b6cd',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.794630] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fe43e864-555f-4ea5-8841-d2bcacb15ecc: rpc.has_security_group_logging(os_id): False [ 632.814908] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.814908] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.814908] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.814908] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.814908] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.814908] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.815323] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.815323] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.815323] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.815323] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.815527] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.815585] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.815644] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.815778] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.815853] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.817283] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.821030] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.821030] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.821030] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.821030] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.821030] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fe43e864-555f-4ea5-8841-d2bcacb15ecc is going to be updated. [ 632.918244] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.918438] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.922260] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.922518] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.922682] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.937218] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92cba5b3-76df-405c-acab-0f3155ce22e5 in Status: SUCCESS [ 632.937218] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92cba5b3-76df-405c-acab-0f3155ce22e5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.937218] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92cba5b3-76df-405c-acab-0f3155ce22e5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.937218] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92cba5b3-76df-405c-acab-0f3155ce22e5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.937394] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.937482] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.937544] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.937801] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.937862] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.937943] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92cba5b3-76df-405c-acab-0f3155ce22e5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.938044] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('92cba5b3-76df-405c-acab-0f3155ce22e5',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.942778] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fe43e864-555f-4ea5-8841-d2bcacb15ecc in Status: IN_PROGRESS for 2s [ 633.209505] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0c8b18c6-dfed-4391-85cd-455fbb35b6cd [ 633.210198] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.210198] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.210198] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.210468] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.212147] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.212323] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0c8b18c6-dfed-4391-85cd-455fbb35b6cd already deleted. [ 633.212429] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0c8b18c6-dfed-4391-85cd-455fbb35b6cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.445458] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('92cba5b3-76df-405c-acab-0f3155ce22e5',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.950364] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 92cba5b3-76df-405c-acab-0f3155ce22e5: rpc.has_security_group_logging(os_id): False [ 633.972251] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.972251] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.972251] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.972251] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.972251] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.972251] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.972251] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.972251] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.972251] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.972251] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.972251] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 92cba5b3-76df-405c-acab-0f3155ce22e5 is going to be created. [ 634.069047] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.069606] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.069677] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.070473] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.070653] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.098934] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 92cba5b3-76df-405c-acab-0f3155ce22e5 in Status: IN_PROGRESS for 2s [ 634.462131] env[62842]: INFO networking_nsxv3.common.synchronization [None req-dd53f394-678a-40d0-8d87-4b1281a65724 None None] Enqueued Resource ID: d5e15eea-c5fe-42c9-9a58-0f6b08847bc4 with Priority: HIGHEST for action port [ 634.462428] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5e15eea-c5fe-42c9-9a58-0f6b08847bc4 with Priority: HIGHEST for action port [ 634.463029] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-d5e15eea-c5fe-42c9-9a58-0f6b08847bc4 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.463168] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d5e15eea-c5fe-42c9-9a58-0f6b08847bc4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.463238] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d5e15eea-c5fe-42c9-9a58-0f6b08847bc4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.463584] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d5e15eea-c5fe-42c9-9a58-0f6b08847bc4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.463737] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5e15eea-c5fe-42c9-9a58-0f6b08847bc4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.962727] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fe43e864-555f-4ea5-8841-d2bcacb15ecc in Status: SUCCESS [ 634.963184] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.966519] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d5e15eea-c5fe-42c9-9a58-0f6b08847bc4 [ 634.966870] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.967079] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.967195] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.967486] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.967828] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.967828] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d5e15eea-c5fe-42c9-9a58-0f6b08847bc4 already deleted. [ 634.967828] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d5e15eea-c5fe-42c9-9a58-0f6b08847bc4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.113553] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 92cba5b3-76df-405c-acab-0f3155ce22e5 in Status: SUCCESS [ 636.113864] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-92cba5b3-76df-405c-acab-0f3155ce22e5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.136021] env[62842]: INFO networking_nsxv3.common.synchronization [req-42df2680-00e9-4f00-b009-1f95418f84f9 req-849a22f7-b7c6-4ed0-ad7a-cb8216bff7ff tempest-ServersWithSpecificFlavorTestJSON-2019624802 tempest-ServersWithSpecificFlavorTestJSON-2019624802-project-member] Enqueued Resource ID: 16baecd6-bda3-40e1-98ef-4e238a3fc354 with Priority: HIGHEST for action security_group_members [ 636.136021] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16baecd6-bda3-40e1-98ef-4e238a3fc354 with Priority: HIGHEST for action security_group_members [ 636.136021] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-16baecd6-bda3-40e1-98ef-4e238a3fc354 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.136021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16baecd6-bda3-40e1-98ef-4e238a3fc354" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.136021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16baecd6-bda3-40e1-98ef-4e238a3fc354" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.136021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16baecd6-bda3-40e1-98ef-4e238a3fc354" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.136526] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.136526] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.136636] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.136813] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.136900] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.137011] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16baecd6-bda3-40e1-98ef-4e238a3fc354',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.594664] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-927 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.594885] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-927" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.594975] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-927" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.595357] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-927" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.595583] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.595739] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.595854] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.596199] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.596467] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.596611] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 636.596756] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 636.596869] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 636.596978] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 636.597102] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 636.597209] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 636.597347] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 636.618834] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 636.619084] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 636.619549] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 636.619856] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-927" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.620292] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-32477d8e-6159-4f77-bb3a-89cf4a92b620 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.620539] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-32477d8e-6159-4f77-bb3a-89cf4a92b620" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.620709] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-32477d8e-6159-4f77-bb3a-89cf4a92b620" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.621135] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-32477d8e-6159-4f77-bb3a-89cf4a92b620" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.621326] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32477d8e-6159-4f77-bb3a-89cf4a92b620',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.640530] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.640705] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.640777] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.641014] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.641160] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.641414] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.641523] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.641587] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.641747] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.641826] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.641911] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16baecd6-bda3-40e1-98ef-4e238a3fc354 already deleted. [ 636.642036] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16baecd6-bda3-40e1-98ef-4e238a3fc354" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.771524] env[62842]: INFO networking_nsxv3.common.synchronization [None req-f9439f01-74ad-472d-8ba1-85165c2bb2bb None None] Enqueued Resource ID: 9acbd3cd-128e-4341-9c8a-22aa7799444a with Priority: HIGHEST for action port [ 636.771783] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9acbd3cd-128e-4341-9c8a-22aa7799444a with Priority: HIGHEST for action port [ 636.772448] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-9acbd3cd-128e-4341-9c8a-22aa7799444a taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.772556] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9acbd3cd-128e-4341-9c8a-22aa7799444a" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.772556] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9acbd3cd-128e-4341-9c8a-22aa7799444a" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.772821] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9acbd3cd-128e-4341-9c8a-22aa7799444a" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.772911] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9acbd3cd-128e-4341-9c8a-22aa7799444a',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.125055] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.125055] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.125055] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.125055] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.125055] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.125725] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 32477d8e-6159-4f77-bb3a-89cf4a92b620 not found, creating... [ 637.125725] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.125725] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.125872] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.126592] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.126592] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.126732] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.126988] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.127212] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.127927] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.127927] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.127927] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 32477d8e-6159-4f77-bb3a-89cf4a92b620 is going to be created. [ 637.158313] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.158577] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.158706] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.159014] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.159283] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.159598] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-32477d8e-6159-4f77-bb3a-89cf4a92b620" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.276328] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9acbd3cd-128e-4341-9c8a-22aa7799444a [ 637.276574] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.276725] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.276805] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.277045] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.277143] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.277242] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9acbd3cd-128e-4341-9c8a-22aa7799444a already deleted. [ 637.277326] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9acbd3cd-128e-4341-9c8a-22aa7799444a" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.079396] env[62842]: INFO networking_nsxv3.common.synchronization [None req-3724ca83-f219-45c4-a3f3-db401aaebd4a None None] Enqueued Resource ID: 16e3ddad-f7f6-4f00-96e2-8355ff65d5b3 with Priority: HIGHEST for action port [ 638.079583] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16e3ddad-f7f6-4f00-96e2-8355ff65d5b3 with Priority: HIGHEST for action port [ 638.080778] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-16e3ddad-f7f6-4f00-96e2-8355ff65d5b3 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.081155] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16e3ddad-f7f6-4f00-96e2-8355ff65d5b3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.081472] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16e3ddad-f7f6-4f00-96e2-8355ff65d5b3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.082557] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16e3ddad-f7f6-4f00-96e2-8355ff65d5b3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.082950] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16e3ddad-f7f6-4f00-96e2-8355ff65d5b3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.257338] env[62842]: INFO networking_nsxv3.common.synchronization [req-42df2680-00e9-4f00-b009-1f95418f84f9 req-8eebfc78-2319-4dc0-8e39-e4783a97325d service nova] Enqueued Resource ID: 16baecd6-bda3-40e1-98ef-4e238a3fc354 with Priority: HIGHEST for action security_group_rules [ 638.258122] env[62842]: INFO networking_nsxv3.common.synchronization [req-42df2680-00e9-4f00-b009-1f95418f84f9 req-8eebfc78-2319-4dc0-8e39-e4783a97325d service nova] Enqueued Resource ID: 16baecd6-bda3-40e1-98ef-4e238a3fc354 with Priority: HIGHEST for action security_group_members [ 638.259021] env[62842]: INFO networking_nsxv3.common.synchronization [req-42df2680-00e9-4f00-b009-1f95418f84f9 req-8eebfc78-2319-4dc0-8e39-e4783a97325d service nova] Enqueued Resource ID: 32477d8e-6159-4f77-bb3a-89cf4a92b620 with Priority: HIGHEST for action port [ 638.261193] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16baecd6-bda3-40e1-98ef-4e238a3fc354 with Priority: HIGHEST for action security_group_rules [ 638.261193] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16baecd6-bda3-40e1-98ef-4e238a3fc354 with Priority: HIGHEST for action security_group_members [ 638.261193] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32477d8e-6159-4f77-bb3a-89cf4a92b620 with Priority: HIGHEST for action port [ 638.261193] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16baecd6-bda3-40e1-98ef-4e238a3fc354 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.261193] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16baecd6-bda3-40e1-98ef-4e238a3fc354" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.261193] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16baecd6-bda3-40e1-98ef-4e238a3fc354" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.261193] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16baecd6-bda3-40e1-98ef-4e238a3fc354" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.263214] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16baecd6-bda3-40e1-98ef-4e238a3fc354',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.264690] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-16baecd6-bda3-40e1-98ef-4e238a3fc354 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.268022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16baecd6-bda3-40e1-98ef-4e238a3fc354" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.268022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16baecd6-bda3-40e1-98ef-4e238a3fc354" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.268022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16baecd6-bda3-40e1-98ef-4e238a3fc354" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.268022] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.268022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.268022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.268022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.268022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.268022] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16baecd6-bda3-40e1-98ef-4e238a3fc354',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.268022] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-32477d8e-6159-4f77-bb3a-89cf4a92b620 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.268022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-32477d8e-6159-4f77-bb3a-89cf4a92b620" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.268022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-32477d8e-6159-4f77-bb3a-89cf4a92b620" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.268022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-32477d8e-6159-4f77-bb3a-89cf4a92b620" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.268022] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32477d8e-6159-4f77-bb3a-89cf4a92b620',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.590447] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 16e3ddad-f7f6-4f00-96e2-8355ff65d5b3 [ 638.590794] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.591042] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.591165] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.591534] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.591686] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.591851] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:16e3ddad-f7f6-4f00-96e2-8355ff65d5b3 already deleted. [ 638.592376] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16e3ddad-f7f6-4f00-96e2-8355ff65d5b3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.601178] env[62842]: INFO networking_nsxv3.common.synchronization [req-1f342c4e-c572-41de-9dcb-26b03b99bba9 req-e5fea099-0275-404d-a83b-9271039cd7ac tempest-ServersAdminTestJSON-1475908229 tempest-ServersAdminTestJSON-1475908229-project-member] Enqueued Resource ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e with Priority: HIGHEST for action security_group_members [ 638.601976] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e with Priority: HIGHEST for action security_group_members [ 638.605079] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.605079] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.605079] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.605079] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.605079] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.605079] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.605079] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.605079] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.605079] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.605079] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7acb0f4-6157-4a0c-977e-ee6a2808aa0e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.774399] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-16baecd6-bda3-40e1-98ef-4e238a3fc354 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.774399] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16baecd6-bda3-40e1-98ef-4e238a3fc354" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.774399] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('16baecd6-bda3-40e1-98ef-4e238a3fc354',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.774399] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 32477d8e-6159-4f77-bb3a-89cf4a92b620 with status ACTIVE [ 638.774399] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.774399] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.774399] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.774399] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.774399] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.774399] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.774399] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.774399] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.774399] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.774399] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.774819] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.774819] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.774819] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.774819] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.774819] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.775193] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 32477d8e-6159-4f77-bb3a-89cf4a92b620 is going to be updated. [ 638.808526] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.808676] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.808750] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.809050] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.809379] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.809481] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-32477d8e-6159-4f77-bb3a-89cf4a92b620" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.108935] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.109125] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.109125] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.109985] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.109985] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.109985] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.110229] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.110229] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.110444] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.111440] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.111440] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e already deleted. [ 639.111440] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.278125] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('16baecd6-bda3-40e1-98ef-4e238a3fc354',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.772655] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-988 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.772807] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-988" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.772861] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-988" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.773294] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-988" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.773785] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.773938] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.774169] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.774449] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.774720] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.775015] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 639.775155] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 639.775353] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 639.775479] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 639.775617] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 639.775764] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 639.775931] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 639.785157] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.785315] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.785387] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.785596] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.785686] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.785786] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16baecd6-bda3-40e1-98ef-4e238a3fc354 is going to be created. [ 639.802909] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 639.802909] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 639.802909] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 639.802909] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-988" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.803541] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-31366500-96e4-43b8-bdf0-b5265a4b64b3 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.803823] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-31366500-96e4-43b8-bdf0-b5265a4b64b3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.803975] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-31366500-96e4-43b8-bdf0-b5265a4b64b3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.804349] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-31366500-96e4-43b8-bdf0-b5265a4b64b3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.804527] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31366500-96e4-43b8-bdf0-b5265a4b64b3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.813900] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.813900] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.814075] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.814211] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.814432] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.825085] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16baecd6-bda3-40e1-98ef-4e238a3fc354 in Status: UNINITIALIZED for 2s [ 640.307026] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.307026] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.307374] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.307488] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.307584] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.307797] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 31366500-96e4-43b8-bdf0-b5265a4b64b3 not found, creating... [ 640.310537] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.310750] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.310877] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.311298] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.311298] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.311598] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.311761] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.311879] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.312124] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.312265] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.312566] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 31366500-96e4-43b8-bdf0-b5265a4b64b3 is going to be created. [ 640.335895] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.336110] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.336326] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.336764] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.337102] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.337102] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-31366500-96e4-43b8-bdf0-b5265a4b64b3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.839529] env[62842]: INFO networking_nsxv3.common.synchronization [None req-df41b9f7-044e-4dac-aef1-6716dff02777 None None] Enqueued Resource ID: 0be7c595-076c-4fa6-821f-9d18342691c0 with Priority: HIGHEST for action port [ 640.840875] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0be7c595-076c-4fa6-821f-9d18342691c0 with Priority: HIGHEST for action port [ 640.843635] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-0be7c595-076c-4fa6-821f-9d18342691c0 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.843635] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0be7c595-076c-4fa6-821f-9d18342691c0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.843635] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0be7c595-076c-4fa6-821f-9d18342691c0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.843635] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0be7c595-076c-4fa6-821f-9d18342691c0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.843635] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0be7c595-076c-4fa6-821f-9d18342691c0',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.346307] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0be7c595-076c-4fa6-821f-9d18342691c0 [ 641.346935] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.346935] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.346935] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.347175] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.347302] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.347435] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0be7c595-076c-4fa6-821f-9d18342691c0 already deleted. [ 641.347573] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0be7c595-076c-4fa6-821f-9d18342691c0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.396267] env[62842]: INFO networking_nsxv3.common.synchronization [req-1f342c4e-c572-41de-9dcb-26b03b99bba9 req-050259a8-522e-4452-b613-596a59157f77 service nova] Enqueued Resource ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e with Priority: HIGHEST for action security_group_rules [ 641.396267] env[62842]: INFO networking_nsxv3.common.synchronization [req-1f342c4e-c572-41de-9dcb-26b03b99bba9 req-050259a8-522e-4452-b613-596a59157f77 service nova] Enqueued Resource ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e with Priority: HIGHEST for action security_group_members [ 641.396267] env[62842]: INFO networking_nsxv3.common.synchronization [req-1f342c4e-c572-41de-9dcb-26b03b99bba9 req-050259a8-522e-4452-b613-596a59157f77 service nova] Enqueued Resource ID: 31366500-96e4-43b8-bdf0-b5265a4b64b3 with Priority: HIGHEST for action port [ 641.396267] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e with Priority: HIGHEST for action security_group_rules [ 641.396267] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e with Priority: HIGHEST for action security_group_members [ 641.396267] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31366500-96e4-43b8-bdf0-b5265a4b64b3 with Priority: HIGHEST for action port [ 641.396745] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.396745] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.396745] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.397275] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.397381] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7acb0f4-6157-4a0c-977e-ee6a2808aa0e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.398340] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.398479] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.398545] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.398761] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.398927] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.399061] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.399165] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.399364] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.399454] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.399546] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7acb0f4-6157-4a0c-977e-ee6a2808aa0e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.401614] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-31366500-96e4-43b8-bdf0-b5265a4b64b3 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.401719] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31366500-96e4-43b8-bdf0-b5265a4b64b3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.401784] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31366500-96e4-43b8-bdf0-b5265a4b64b3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.401941] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31366500-96e4-43b8-bdf0-b5265a4b64b3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.402025] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31366500-96e4-43b8-bdf0-b5265a4b64b3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.841718] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16baecd6-bda3-40e1-98ef-4e238a3fc354 in Status: SUCCESS [ 641.841718] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16baecd6-bda3-40e1-98ef-4e238a3fc354" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.841718] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16baecd6-bda3-40e1-98ef-4e238a3fc354" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.841718] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16baecd6-bda3-40e1-98ef-4e238a3fc354" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.841718] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.841718] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.841718] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.841718] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.841718] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.841718] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16baecd6-bda3-40e1-98ef-4e238a3fc354" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.841718] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('16baecd6-bda3-40e1-98ef-4e238a3fc354',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.903469] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.903978] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.910158] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 31366500-96e4-43b8-bdf0-b5265a4b64b3 with status ACTIVE [ 641.910158] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.910158] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.910158] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.910158] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.910158] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.910158] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.910158] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.910158] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.910158] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.910158] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.910158] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.910158] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.910158] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.910158] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.910158] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.910158] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 31366500-96e4-43b8-bdf0-b5265a4b64b3 is going to be updated. [ 641.913295] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e7acb0f4-6157-4a0c-977e-ee6a2808aa0e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.938799] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.941853] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.941853] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.941853] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.941853] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.941853] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31366500-96e4-43b8-bdf0-b5265a4b64b3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.956812] env[62842]: INFO networking_nsxv3.common.synchronization [req-39059053-7d12-4eed-a189-1b9131049d29 req-e053c5b4-e1a2-4634-b293-66fbcf838634 tempest-AttachVolumeNegativeTest-1420230652 tempest-AttachVolumeNegativeTest-1420230652-project-member] Enqueued Resource ID: c0ccbbde-9e94-45de-b00c-8f135b84465d with Priority: HIGHEST for action security_group_members [ 641.957558] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0ccbbde-9e94-45de-b00c-8f135b84465d with Priority: HIGHEST for action security_group_members [ 641.957641] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0ccbbde-9e94-45de-b00c-8f135b84465d taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.957771] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0ccbbde-9e94-45de-b00c-8f135b84465d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.957842] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0ccbbde-9e94-45de-b00c-8f135b84465d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.962803] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0ccbbde-9e94-45de-b00c-8f135b84465d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.962803] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.962803] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.962803] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.962803] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.962803] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.962803] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0ccbbde-9e94-45de-b00c-8f135b84465d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.344027] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('16baecd6-bda3-40e1-98ef-4e238a3fc354',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.417022] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e7acb0f4-6157-4a0c-977e-ee6a2808aa0e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.465496] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.465675] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.465731] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.465933] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.466039] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.466241] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.466369] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.466427] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.466545] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.466623] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.466702] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0ccbbde-9e94-45de-b00c-8f135b84465d already deleted. [ 642.466779] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0ccbbde-9e94-45de-b00c-8f135b84465d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.612803] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-468 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.615700] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-468" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.616480] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-468" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.616912] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-468" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.617306] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.618372] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.618768] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.618972] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.619246] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.619555] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 642.619741] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 642.620025] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 642.620174] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 642.620358] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 642.621085] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 642.621085] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 642.691689] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 642.691689] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.070 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 642.691689] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 642.691689] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-468" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.691869] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-5125406f-f317-4a0e-9ed7-29bc653886ab taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.692047] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-5125406f-f317-4a0e-9ed7-29bc653886ab" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.692168] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-5125406f-f317-4a0e-9ed7-29bc653886ab" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.692525] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-5125406f-f317-4a0e-9ed7-29bc653886ab" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.692666] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5125406f-f317-4a0e-9ed7-29bc653886ab',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.847211] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 16baecd6-bda3-40e1-98ef-4e238a3fc354: rpc.has_security_group_logging(os_id): False [ 642.870172] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.870330] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.870401] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.870681] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.870739] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.871014] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.871116] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.871175] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.871338] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.871435] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.871522] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16baecd6-bda3-40e1-98ef-4e238a3fc354 is going to be created. [ 642.922056] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.922056] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.922056] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.922056] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.922056] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.922949] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e is going to be created. [ 642.949356] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.949513] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.949608] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.949883] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.950132] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.956557] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.960020] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.960020] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.960020] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.960020] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.995619] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e in Status: UNINITIALIZED for 2s [ 643.001984] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16baecd6-bda3-40e1-98ef-4e238a3fc354 in Status: IN_PROGRESS for 2s [ 643.196254] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.196254] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.196254] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.196534] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.196688] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.196850] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 5125406f-f317-4a0e-9ed7-29bc653886ab not found, creating... [ 643.197417] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.197417] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.197417] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.197673] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.198204] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.198204] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.198368] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.198616] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.198738] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.198874] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.199024] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 5125406f-f317-4a0e-9ed7-29bc653886ab is going to be created. [ 643.219788] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.220059] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.220123] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.220398] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.220713] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.220944] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-5125406f-f317-4a0e-9ed7-29bc653886ab" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.073720] env[62842]: INFO networking_nsxv3.common.synchronization [req-39059053-7d12-4eed-a189-1b9131049d29 req-214fd044-d02c-4ae7-bc8b-035559ae3424 service nova] Enqueued Resource ID: c0ccbbde-9e94-45de-b00c-8f135b84465d with Priority: HIGHEST for action security_group_rules [ 644.073720] env[62842]: INFO networking_nsxv3.common.synchronization [req-39059053-7d12-4eed-a189-1b9131049d29 req-214fd044-d02c-4ae7-bc8b-035559ae3424 service nova] Enqueued Resource ID: c0ccbbde-9e94-45de-b00c-8f135b84465d with Priority: HIGHEST for action security_group_members [ 644.073720] env[62842]: INFO networking_nsxv3.common.synchronization [req-39059053-7d12-4eed-a189-1b9131049d29 req-214fd044-d02c-4ae7-bc8b-035559ae3424 service nova] Enqueued Resource ID: 5125406f-f317-4a0e-9ed7-29bc653886ab with Priority: HIGHEST for action port [ 644.078911] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0ccbbde-9e94-45de-b00c-8f135b84465d with Priority: HIGHEST for action security_group_rules [ 644.079189] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0ccbbde-9e94-45de-b00c-8f135b84465d with Priority: HIGHEST for action security_group_members [ 644.079337] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5125406f-f317-4a0e-9ed7-29bc653886ab with Priority: HIGHEST for action port [ 644.079686] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0ccbbde-9e94-45de-b00c-8f135b84465d taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.079857] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0ccbbde-9e94-45de-b00c-8f135b84465d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.079959] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0ccbbde-9e94-45de-b00c-8f135b84465d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.080162] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0ccbbde-9e94-45de-b00c-8f135b84465d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.080258] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0ccbbde-9e94-45de-b00c-8f135b84465d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.083497] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0ccbbde-9e94-45de-b00c-8f135b84465d taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.083497] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0ccbbde-9e94-45de-b00c-8f135b84465d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.083497] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0ccbbde-9e94-45de-b00c-8f135b84465d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.083798] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0ccbbde-9e94-45de-b00c-8f135b84465d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.084078] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.084218] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.084320] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.084617] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.084696] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.084813] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0ccbbde-9e94-45de-b00c-8f135b84465d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.085895] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-5125406f-f317-4a0e-9ed7-29bc653886ab taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.092361] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5125406f-f317-4a0e-9ed7-29bc653886ab" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.092361] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5125406f-f317-4a0e-9ed7-29bc653886ab" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.092361] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5125406f-f317-4a0e-9ed7-29bc653886ab" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.092361] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5125406f-f317-4a0e-9ed7-29bc653886ab',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.462274] env[62842]: INFO networking_nsxv3.common.synchronization [req-0b745c88-68a0-43f6-84fb-2c4251912ffd req-d3a4b3a4-1e4c-4be2-9ba4-02184643e1e7 tempest-ServersAdminTestJSON-1475908229 tempest-ServersAdminTestJSON-1475908229-project-member] Enqueued Resource ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e with Priority: HIGHEST for action security_group_members [ 644.463369] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e with Priority: HIGHEST for action security_group_members [ 644.463600] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.463789] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.591994] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0ccbbde-9e94-45de-b00c-8f135b84465d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.593098] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0ccbbde-9e94-45de-b00c-8f135b84465d taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.593200] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0ccbbde-9e94-45de-b00c-8f135b84465d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.595408] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5125406f-f317-4a0e-9ed7-29bc653886ab with status ACTIVE [ 644.595788] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.595958] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.596030] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.596194] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.596307] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.596489] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.596595] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.596661] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.596833] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.596973] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.597107] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.597195] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.597256] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.597686] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.597686] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.597686] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5125406f-f317-4a0e-9ed7-29bc653886ab is going to be updated. [ 644.622477] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.622621] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.622710] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.622894] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.623040] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.623200] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5125406f-f317-4a0e-9ed7-29bc653886ab" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.901602] env[62842]: INFO networking_nsxv3.common.synchronization [req-e4733a67-aaf3-4da1-82cd-2b8500410ba3 req-6cf2e2f6-f0d3-4458-b003-4f8c37acf167 tempest-FloatingIPsAssociationNegativeTestJSON-318606088 tempest-FloatingIPsAssociationNegativeTestJSON-318606088-project-member] Enqueued Resource ID: 3a92b1e9-7c4f-4a77-a09f-3ba0782fff02 with Priority: HIGHEST for action security_group_members [ 644.902243] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a92b1e9-7c4f-4a77-a09f-3ba0782fff02 with Priority: HIGHEST for action security_group_members [ 644.902607] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a92b1e9-7c4f-4a77-a09f-3ba0782fff02 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.905020] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a92b1e9-7c4f-4a77-a09f-3ba0782fff02" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.905020] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a92b1e9-7c4f-4a77-a09f-3ba0782fff02" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.905020] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a92b1e9-7c4f-4a77-a09f-3ba0782fff02" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.905856] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.905981] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.906182] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.906479] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.906576] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.906675] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a92b1e9-7c4f-4a77-a09f-3ba0782fff02',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.007942] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e in Status: SUCCESS [ 645.008205] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.012952] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.012952] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.012952] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.012952] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.012952] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.012952] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.012952] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.012952] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.012952] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e7acb0f4-6157-4a0c-977e-ee6a2808aa0e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.013490] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.013490] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.013573] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.013843] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.013843] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.013967] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.014238] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.014388] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7acb0f4-6157-4a0c-977e-ee6a2808aa0e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.020224] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16baecd6-bda3-40e1-98ef-4e238a3fc354 in Status: SUCCESS [ 645.020224] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16baecd6-bda3-40e1-98ef-4e238a3fc354" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.040476] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-988 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.040763] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-988" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.040930] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-988" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.041287] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-988" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.042079] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.042262] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.042539] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.043258] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.043512] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.044229] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 645.044229] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 645.044229] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 645.044229] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 645.044530] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 645.044530] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 645.044587] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 645.071539] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 645.071539] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 645.071539] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 645.071539] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-988" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.071539] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-bf0c895f-8a51-47e7-bee9-d232ace2d753 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.071539] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-bf0c895f-8a51-47e7-bee9-d232ace2d753" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.071539] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-bf0c895f-8a51-47e7-bee9-d232ace2d753" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.071539] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-bf0c895f-8a51-47e7-bee9-d232ace2d753" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.072152] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf0c895f-8a51-47e7-bee9-d232ace2d753',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.094425] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0ccbbde-9e94-45de-b00c-8f135b84465d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.409783] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.409978] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.409978] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.410195] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.410300] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.410508] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.410608] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.410713] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.410904] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.410968] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.411084] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a92b1e9-7c4f-4a77-a09f-3ba0782fff02 is going to be updated. [ 645.441652] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.441836] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.441924] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.442174] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.442350] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.453974] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a92b1e9-7c4f-4a77-a09f-3ba0782fff02 in Status: IN_PROGRESS for 2s [ 645.519592] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.519751] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.519924] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e7acb0f4-6157-4a0c-977e-ee6a2808aa0e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.574979] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.575396] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.575396] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.575698] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.577030] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.577030] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port bf0c895f-8a51-47e7-bee9-d232ace2d753 not found, creating... [ 645.577030] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.577030] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.577030] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.577030] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.577462] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.577462] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.577543] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.577660] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.577868] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.577999] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.578155] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: bf0c895f-8a51-47e7-bee9-d232ace2d753 is going to be created. [ 645.597195] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.598027] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.598027] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.598027] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.598027] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.598027] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0ccbbde-9e94-45de-b00c-8f135b84465d is going to be created. [ 645.613941] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.614840] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.614840] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.614840] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.615016] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.615202] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-bf0c895f-8a51-47e7-bee9-d232ace2d753" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.637077] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.637252] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.637341] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.637518] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.637678] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.651513] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0ccbbde-9e94-45de-b00c-8f135b84465d in Status: UNINITIALIZED for 2s [ 646.022154] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e7acb0f4-6157-4a0c-977e-ee6a2808aa0e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.527667] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.527965] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.527965] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.528272] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.528421] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.528536] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e is going to be updated. [ 646.564811] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.564811] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.564811] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.564811] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.564978] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.582793] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e in Status: IN_PROGRESS for 2s [ 646.733242] env[62842]: INFO networking_nsxv3.common.synchronization [req-0b745c88-68a0-43f6-84fb-2c4251912ffd req-dd2277ac-7359-487a-ae25-29317ab86ff6 service nova] Enqueued Resource ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e with Priority: HIGHEST for action security_group_rules [ 646.733242] env[62842]: INFO networking_nsxv3.common.synchronization [req-0b745c88-68a0-43f6-84fb-2c4251912ffd req-dd2277ac-7359-487a-ae25-29317ab86ff6 service nova] Enqueued Resource ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e with Priority: HIGHEST for action security_group_members [ 646.733242] env[62842]: INFO networking_nsxv3.common.synchronization [req-0b745c88-68a0-43f6-84fb-2c4251912ffd req-dd2277ac-7359-487a-ae25-29317ab86ff6 service nova] Enqueued Resource ID: bf0c895f-8a51-47e7-bee9-d232ace2d753 with Priority: HIGHEST for action port [ 646.733242] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e with Priority: HIGHEST for action security_group_rules [ 646.733783] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e with Priority: HIGHEST for action security_group_members [ 646.733783] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf0c895f-8a51-47e7-bee9-d232ace2d753 with Priority: HIGHEST for action port [ 646.733783] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.733936] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.733988] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.735174] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.735371] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf0c895f-8a51-47e7-bee9-d232ace2d753 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.735371] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf0c895f-8a51-47e7-bee9-d232ace2d753" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.735371] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf0c895f-8a51-47e7-bee9-d232ace2d753" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.735598] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf0c895f-8a51-47e7-bee9-d232ace2d753" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.735673] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf0c895f-8a51-47e7-bee9-d232ace2d753',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.239283] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bf0c895f-8a51-47e7-bee9-d232ace2d753 with status ACTIVE [ 647.239524] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.239699] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.239772] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.240043] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.240125] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.240309] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.242552] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.242552] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.242552] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.242552] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.242552] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.242552] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.242552] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.242552] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.242552] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.242552] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bf0c895f-8a51-47e7-bee9-d232ace2d753 is going to be updated. [ 647.277598] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.277598] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.277598] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.277598] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.277598] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.277598] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf0c895f-8a51-47e7-bee9-d232ace2d753" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.288186] env[62842]: INFO networking_nsxv3.common.synchronization [req-d4002de1-0e56-4217-ba2d-21a95da84dee req-bbbeec22-0257-46b5-b8bd-8db5b9793936 tempest-ListServerFiltersTestJSON-2112811092 tempest-ListServerFiltersTestJSON-2112811092-project-member] Enqueued Resource ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 with Priority: HIGHEST for action security_group_members [ 647.288186] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 with Priority: HIGHEST for action security_group_members [ 647.288186] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-331dd47d-e3b4-4338-b588-cd456a9aa5f7 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.288186] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.288186] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.288186] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.288186] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.288186] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.288186] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.288186] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.289091] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.289638] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('331dd47d-e3b4-4338-b588-cd456a9aa5f7',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.468404] env[62842]: INFO networking_nsxv3.common.synchronization [req-3d4b908a-1cb6-4890-8fad-1ef16db049af req-a1db3102-3d53-424b-b3dd-7cec11139bdf tempest-InstanceActionsNegativeTestJSON-1914610906 tempest-InstanceActionsNegativeTestJSON-1914610906-project-member] Enqueued Resource ID: 534d1af9-5f3d-417d-8cb4-3116f2425761 with Priority: HIGHEST for action security_group_members [ 647.470263] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 534d1af9-5f3d-417d-8cb4-3116f2425761 with Priority: HIGHEST for action security_group_members [ 647.470693] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-534d1af9-5f3d-417d-8cb4-3116f2425761 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.470843] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-534d1af9-5f3d-417d-8cb4-3116f2425761" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.471045] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-534d1af9-5f3d-417d-8cb4-3116f2425761" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.471209] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-534d1af9-5f3d-417d-8cb4-3116f2425761" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.471374] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.471481] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.471562] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.472268] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.472268] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.472268] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('534d1af9-5f3d-417d-8cb4-3116f2425761',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.474023] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a92b1e9-7c4f-4a77-a09f-3ba0782fff02 in Status: SUCCESS [ 647.474296] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a92b1e9-7c4f-4a77-a09f-3ba0782fff02 deletion is rescheduled due to dependency. [ 647.474296] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a92b1e9-7c4f-4a77-a09f-3ba0782fff02" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.663570] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0ccbbde-9e94-45de-b00c-8f135b84465d in Status: SUCCESS [ 647.663570] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0ccbbde-9e94-45de-b00c-8f135b84465d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.663570] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0ccbbde-9e94-45de-b00c-8f135b84465d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.663889] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0ccbbde-9e94-45de-b00c-8f135b84465d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.663918] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.664070] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.664134] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.664290] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.664380] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.664516] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0ccbbde-9e94-45de-b00c-8f135b84465d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.664563] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c0ccbbde-9e94-45de-b00c-8f135b84465d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.792448] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('331dd47d-e3b4-4338-b588-cd456a9aa5f7',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.977067] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.977289] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.977289] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.977690] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.977818] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.978159] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.978515] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.978515] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.978661] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.978740] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.978926] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 534d1af9-5f3d-417d-8cb4-3116f2425761 already deleted. [ 647.979050] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-534d1af9-5f3d-417d-8cb4-3116f2425761" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.168738] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c0ccbbde-9e94-45de-b00c-8f135b84465d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.224564] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-569 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.224564] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-569" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.224775] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-569" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.225757] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-569" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.225757] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.225757] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.225757] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.225975] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.226052] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.226282] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 648.226392] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 648.226496] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 648.226599] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 648.226704] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 648.226804] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 648.226934] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 648.251275] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 648.251275] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 648.251347] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 648.251700] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-569" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.252163] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-b6f9bfb6-367e-4b1f-a9b1-9bc05fdeacf2 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.252263] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-b6f9bfb6-367e-4b1f-a9b1-9bc05fdeacf2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.252485] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-b6f9bfb6-367e-4b1f-a9b1-9bc05fdeacf2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.253275] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-b6f9bfb6-367e-4b1f-a9b1-9bc05fdeacf2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.253275] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6f9bfb6-367e-4b1f-a9b1-9bc05fdeacf2',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.295870] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('331dd47d-e3b4-4338-b588-cd456a9aa5f7',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.600506] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e in Status: SUCCESS [ 648.600506] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.600506] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.600506] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.600974] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.600974] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.601175] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.601316] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.601461] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.601609] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.601858] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.601996] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.602119] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.602327] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.602536] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.602729] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.602800] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.602991] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.603147] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.603359] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.603430] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e7acb0f4-6157-4a0c-977e-ee6a2808aa0e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.604369] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.604614] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.606445] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.606561] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.606630] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.606792] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.606877] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.606978] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7acb0f4-6157-4a0c-977e-ee6a2808aa0e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.671165] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c0ccbbde-9e94-45de-b00c-8f135b84465d: rpc.has_security_group_logging(os_id): False [ 648.701203] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.701203] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.701356] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.701497] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.701902] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.701902] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.702034] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.702034] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.702146] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.702261] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.702306] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0ccbbde-9e94-45de-b00c-8f135b84465d is going to be created. [ 648.757082] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.757373] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.757460] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.757811] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.757900] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.758077] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port b6f9bfb6-367e-4b1f-a9b1-9bc05fdeacf2 not found, creating... [ 648.758392] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.758586] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.758752] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.758942] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.759110] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.759388] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.759566] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.759688] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.759922] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.760205] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.760304] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: b6f9bfb6-367e-4b1f-a9b1-9bc05fdeacf2 is going to be created. [ 648.786157] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.786743] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.787033] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.787427] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.787871] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.788198] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-b6f9bfb6-367e-4b1f-a9b1-9bc05fdeacf2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.792022] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.792152] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.792258] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.792470] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.792658] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.799191] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.799408] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.799493] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.799668] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.799766] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.799885] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 is going to be updated. [ 648.810754] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0ccbbde-9e94-45de-b00c-8f135b84465d in Status: IN_PROGRESS for 2s [ 648.849328] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.849523] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.849571] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.849809] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.849968] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.860970] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 in Status: IN_PROGRESS for 2s [ 649.109055] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e7acb0f4-6157-4a0c-977e-ee6a2808aa0e: rpc.has_security_group_logging(os_id): False [ 649.110238] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e7acb0f4-6157-4a0c-977e-ee6a2808aa0e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.133481] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.133481] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.133481] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.133686] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.134417] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.134417] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.134417] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.134417] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.134417] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.134767] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.134767] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.134767] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.134767] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.134901] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.135042] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.135180] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.135278] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.135344] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.135510] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.135587] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.135656] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e is going to be created. [ 649.209626] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.209860] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.209927] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.210155] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.210353] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.225894] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e in Status: IN_PROGRESS for 2s [ 649.615967] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e7acb0f4-6157-4a0c-977e-ee6a2808aa0e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.793344] env[62842]: INFO networking_nsxv3.common.synchronization [req-3d4b908a-1cb6-4890-8fad-1ef16db049af req-4a31a9f5-355f-4472-b98a-5f37866837b0 service nova] Enqueued Resource ID: 534d1af9-5f3d-417d-8cb4-3116f2425761 with Priority: HIGHEST for action security_group_rules [ 649.794538] env[62842]: INFO networking_nsxv3.common.synchronization [req-3d4b908a-1cb6-4890-8fad-1ef16db049af req-4a31a9f5-355f-4472-b98a-5f37866837b0 service nova] Enqueued Resource ID: 534d1af9-5f3d-417d-8cb4-3116f2425761 with Priority: HIGHEST for action security_group_members [ 649.794726] env[62842]: INFO networking_nsxv3.common.synchronization [req-3d4b908a-1cb6-4890-8fad-1ef16db049af req-4a31a9f5-355f-4472-b98a-5f37866837b0 service nova] Enqueued Resource ID: b6f9bfb6-367e-4b1f-a9b1-9bc05fdeacf2 with Priority: HIGHEST for action port [ 649.795312] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 534d1af9-5f3d-417d-8cb4-3116f2425761 with Priority: HIGHEST for action security_group_rules [ 649.795447] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 534d1af9-5f3d-417d-8cb4-3116f2425761 with Priority: HIGHEST for action security_group_members [ 649.795541] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6f9bfb6-367e-4b1f-a9b1-9bc05fdeacf2 with Priority: HIGHEST for action port [ 649.795843] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-534d1af9-5f3d-417d-8cb4-3116f2425761 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.795939] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-534d1af9-5f3d-417d-8cb4-3116f2425761" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.796021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-534d1af9-5f3d-417d-8cb4-3116f2425761" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.799261] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-534d1af9-5f3d-417d-8cb4-3116f2425761" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.799358] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('534d1af9-5f3d-417d-8cb4-3116f2425761',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.800822] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-534d1af9-5f3d-417d-8cb4-3116f2425761 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.800949] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-534d1af9-5f3d-417d-8cb4-3116f2425761" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.801051] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-534d1af9-5f3d-417d-8cb4-3116f2425761" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.801250] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-534d1af9-5f3d-417d-8cb4-3116f2425761" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.804052] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.804052] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.804052] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.804052] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.804052] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.804052] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('534d1af9-5f3d-417d-8cb4-3116f2425761',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.804838] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-b6f9bfb6-367e-4b1f-a9b1-9bc05fdeacf2 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.804838] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b6f9bfb6-367e-4b1f-a9b1-9bc05fdeacf2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.805029] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b6f9bfb6-367e-4b1f-a9b1-9bc05fdeacf2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.805211] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b6f9bfb6-367e-4b1f-a9b1-9bc05fdeacf2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.805275] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6f9bfb6-367e-4b1f-a9b1-9bc05fdeacf2',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.120869] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.121933] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.122079] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.122295] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.122397] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.122514] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e is going to be updated. [ 650.188053] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.188221] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.189131] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.189131] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.189131] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.200474] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e in Status: IN_PROGRESS for 2s [ 650.305851] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('534d1af9-5f3d-417d-8cb4-3116f2425761',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.307365] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-534d1af9-5f3d-417d-8cb4-3116f2425761 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.307365] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-534d1af9-5f3d-417d-8cb4-3116f2425761" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.308829] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b6f9bfb6-367e-4b1f-a9b1-9bc05fdeacf2 with status ACTIVE [ 650.309047] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.309169] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.309243] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.309449] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.310109] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.310315] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.310424] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.310489] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.310670] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.310769] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.310983] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.311125] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.311167] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.311307] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.311376] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.311462] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b6f9bfb6-367e-4b1f-a9b1-9bc05fdeacf2 is going to be updated. [ 650.343088] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.343243] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.343346] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.345752] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.345752] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.345752] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b6f9bfb6-367e-4b1f-a9b1-9bc05fdeacf2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.817236] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('534d1af9-5f3d-417d-8cb4-3116f2425761',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.829511] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0ccbbde-9e94-45de-b00c-8f135b84465d in Status: SUCCESS [ 650.829752] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0ccbbde-9e94-45de-b00c-8f135b84465d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.872965] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 in Status: SUCCESS [ 650.873201] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.243059] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e in Status: SUCCESS [ 651.243298] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.243481] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.243752] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.243840] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7acb0f4-6157-4a0c-977e-ee6a2808aa0e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.320275] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.320275] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.320275] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.320520] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.320611] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.320725] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 534d1af9-5f3d-417d-8cb4-3116f2425761 is going to be created. [ 651.346919] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.346919] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.346919] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.347154] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.347319] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.361151] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 534d1af9-5f3d-417d-8cb4-3116f2425761 in Status: UNINITIALIZED for 2s [ 651.746847] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.747025] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.213673] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e in Status: SUCCESS [ 652.214092] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.214092] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.214365] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.214664] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.214849] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.214954] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.224027] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.224027] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.224027] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.224027] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e7acb0f4-6157-4a0c-977e-ee6a2808aa0e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.726158] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.726507] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.726507] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.726682] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.726827] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.726937] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.727025] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.727187] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.727281] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.727375] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.727534] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.727636] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.727729] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.728034] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.728232] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.728398] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.728473] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.728649] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.728827] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.728882] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.728948] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e7acb0f4-6157-4a0c-977e-ee6a2808aa0e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.233492] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e7acb0f4-6157-4a0c-977e-ee6a2808aa0e: rpc.has_security_group_logging(os_id): False [ 653.254635] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.254782] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.254854] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.255159] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.255497] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.257588] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.257737] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.257812] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.258030] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.258130] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.258359] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.258663] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.258663] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.258802] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.258802] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.259031] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.259141] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.259202] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.259371] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.259437] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.259564] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e is going to be updated. [ 653.337954] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.338360] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.338571] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.338899] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.339157] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.358930] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e in Status: IN_PROGRESS for 2s [ 653.374875] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 534d1af9-5f3d-417d-8cb4-3116f2425761 in Status: SUCCESS [ 653.375116] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-534d1af9-5f3d-417d-8cb4-3116f2425761" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.375280] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-534d1af9-5f3d-417d-8cb4-3116f2425761" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.375507] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-534d1af9-5f3d-417d-8cb4-3116f2425761" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.375649] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.375755] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.375829] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.375961] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.376062] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.376143] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-534d1af9-5f3d-417d-8cb4-3116f2425761" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.376228] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('534d1af9-5f3d-417d-8cb4-3116f2425761',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.880980] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-534d1af9-5f3d-417d-8cb4-3116f2425761 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.881189] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-534d1af9-5f3d-417d-8cb4-3116f2425761" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.881258] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-534d1af9-5f3d-417d-8cb4-3116f2425761" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.881481] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-534d1af9-5f3d-417d-8cb4-3116f2425761" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.881660] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.881758] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.881948] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.882038] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.882069] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.882156] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-534d1af9-5f3d-417d-8cb4-3116f2425761" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.882328] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-534d1af9-5f3d-417d-8cb4-3116f2425761 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.882948] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-534d1af9-5f3d-417d-8cb4-3116f2425761" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.882948] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-534d1af9-5f3d-417d-8cb4-3116f2425761" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.882948] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-534d1af9-5f3d-417d-8cb4-3116f2425761" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.882948] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.882948] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.882948] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.883160] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.883160] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.883160] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-534d1af9-5f3d-417d-8cb4-3116f2425761" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.883233] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('534d1af9-5f3d-417d-8cb4-3116f2425761',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.388251] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 534d1af9-5f3d-417d-8cb4-3116f2425761: rpc.has_security_group_logging(os_id): False [ 654.412989] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.413163] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.413296] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.413628] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.413729] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.414042] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.414134] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.414185] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.414431] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.415116] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.415116] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.415116] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.415116] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.415116] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.415412] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.415412] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.415537] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.415537] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.415662] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.415734] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.415820] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 534d1af9-5f3d-417d-8cb4-3116f2425761 is going to be created. [ 654.490234] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.490544] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.490544] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.490948] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.491271] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.509818] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 534d1af9-5f3d-417d-8cb4-3116f2425761 in Status: IN_PROGRESS for 2s [ 654.796486] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 654.796693] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 655.376400] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e in Status: SUCCESS [ 655.376705] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.113139] env[62842]: INFO networking_nsxv3.common.synchronization [req-cb6ef00c-d6aa-409c-8768-1eed818afdd2 req-0078805d-609b-4aa6-b1b6-23fd1fa5a980 tempest-DeleteServersAdminTestJSON-2057441283 tempest-DeleteServersAdminTestJSON-2057441283-project-member] Enqueued Resource ID: d014d213-d805-403a-bcc9-8c66da8eefa2 with Priority: HIGHEST for action security_group_members [ 656.115217] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d014d213-d805-403a-bcc9-8c66da8eefa2 with Priority: HIGHEST for action security_group_members [ 656.115611] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-d014d213-d805-403a-bcc9-8c66da8eefa2 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.115778] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.115891] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.116143] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.116354] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.116679] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.116679] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.116752] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.116821] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.116963] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d014d213-d805-403a-bcc9-8c66da8eefa2',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.524083] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 534d1af9-5f3d-417d-8cb4-3116f2425761 in Status: SUCCESS [ 656.524414] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-534d1af9-5f3d-417d-8cb4-3116f2425761" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.620139] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.620139] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.620139] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.620468] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.620566] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.620921] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.621204] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.621204] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.621441] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.621662] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.621716] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d014d213-d805-403a-bcc9-8c66da8eefa2 is going to be updated. [ 656.663668] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.663668] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.663668] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.663668] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.663668] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.678662] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d014d213-d805-403a-bcc9-8c66da8eefa2 in Status: IN_PROGRESS for 2s [ 656.994081] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-938 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.994081] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-938" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.994081] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-938" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.994081] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-938" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.998475] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.998475] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.998475] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.998730] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.998804] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.999094] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 656.999158] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 656.999837] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 656.999837] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 656.999837] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 656.999837] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 656.999837] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 657.030823] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 657.030927] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 657.031088] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 657.031359] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-938" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.033059] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-e0d11c0d-d425-4ff8-8294-ad2a0ccec36a taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.033059] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-e0d11c0d-d425-4ff8-8294-ad2a0ccec36a" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.033059] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-e0d11c0d-d425-4ff8-8294-ad2a0ccec36a" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.033059] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-e0d11c0d-d425-4ff8-8294-ad2a0ccec36a" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.033059] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0d11c0d-d425-4ff8-8294-ad2a0ccec36a',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.536020] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.536600] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.536600] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.536820] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.536820] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.537016] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port e0d11c0d-d425-4ff8-8294-ad2a0ccec36a not found, creating... [ 657.537256] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.537407] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.537530] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.537729] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.537858] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.538169] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.538323] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.538481] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.538744] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.538885] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.539074] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: e0d11c0d-d425-4ff8-8294-ad2a0ccec36a is going to be created. [ 657.640064] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.640270] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.640419] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.640814] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.641095] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.641706] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-e0d11c0d-d425-4ff8-8294-ad2a0ccec36a" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.645142] env[62842]: INFO networking_nsxv3.common.synchronization [req-cb6ef00c-d6aa-409c-8768-1eed818afdd2 req-72d10ca8-9f33-42c6-9f5d-5d584463d0b5 service nova] Enqueued Resource ID: d014d213-d805-403a-bcc9-8c66da8eefa2 with Priority: HIGHEST for action security_group_rules [ 658.645142] env[62842]: INFO networking_nsxv3.common.synchronization [req-cb6ef00c-d6aa-409c-8768-1eed818afdd2 req-72d10ca8-9f33-42c6-9f5d-5d584463d0b5 service nova] Enqueued Resource ID: d014d213-d805-403a-bcc9-8c66da8eefa2 with Priority: HIGHEST for action security_group_members [ 658.645142] env[62842]: INFO networking_nsxv3.common.synchronization [req-cb6ef00c-d6aa-409c-8768-1eed818afdd2 req-72d10ca8-9f33-42c6-9f5d-5d584463d0b5 service nova] Enqueued Resource ID: e0d11c0d-d425-4ff8-8294-ad2a0ccec36a with Priority: HIGHEST for action port [ 658.645142] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d014d213-d805-403a-bcc9-8c66da8eefa2 with Priority: HIGHEST for action security_group_rules [ 658.645142] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d014d213-d805-403a-bcc9-8c66da8eefa2 with Priority: HIGHEST for action security_group_members [ 658.645142] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0d11c0d-d425-4ff8-8294-ad2a0ccec36a with Priority: HIGHEST for action port [ 658.646622] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d014d213-d805-403a-bcc9-8c66da8eefa2 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.647072] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.647225] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.647591] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.647803] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d014d213-d805-403a-bcc9-8c66da8eefa2',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.649463] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-d014d213-d805-403a-bcc9-8c66da8eefa2 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.653027] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.653027] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-e0d11c0d-d425-4ff8-8294-ad2a0ccec36a taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.653027] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e0d11c0d-d425-4ff8-8294-ad2a0ccec36a" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.653027] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e0d11c0d-d425-4ff8-8294-ad2a0ccec36a" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.653027] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e0d11c0d-d425-4ff8-8294-ad2a0ccec36a" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.653027] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0d11c0d-d425-4ff8-8294-ad2a0ccec36a',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.692173] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d014d213-d805-403a-bcc9-8c66da8eefa2 in Status: IN_PROGRESS for 4s [ 659.093996] env[62842]: INFO networking_nsxv3.common.synchronization [req-19d299f0-d9d8-47df-a9eb-bb224365d233 req-a79ccf51-f807-4115-9baf-98765174484c tempest-ServerDiagnosticsNegativeTest-466073960 tempest-ServerDiagnosticsNegativeTest-466073960-project-member] Enqueued Resource ID: 66f4c424-4062-4ad5-867d-4d48776176cd with Priority: HIGHEST for action security_group_members [ 659.094647] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66f4c424-4062-4ad5-867d-4d48776176cd with Priority: HIGHEST for action security_group_members [ 659.094974] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-66f4c424-4062-4ad5-867d-4d48776176cd taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.095201] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66f4c424-4062-4ad5-867d-4d48776176cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.095271] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66f4c424-4062-4ad5-867d-4d48776176cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.095730] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66f4c424-4062-4ad5-867d-4d48776176cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.095847] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.095953] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.096025] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.096217] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.096319] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.096696] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66f4c424-4062-4ad5-867d-4d48776176cd',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.154277] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-d014d213-d805-403a-bcc9-8c66da8eefa2 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.154585] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.154749] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e0d11c0d-d425-4ff8-8294-ad2a0ccec36a with status ACTIVE [ 659.155240] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.155240] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.155240] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.155526] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.155662] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.156312] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.156312] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.156312] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.156498] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.156630] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.156913] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.157110] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.157189] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.157363] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.157473] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.157597] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e0d11c0d-d425-4ff8-8294-ad2a0ccec36a is going to be updated. [ 659.193871] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.194062] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.194062] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.194320] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.194571] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.194777] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e0d11c0d-d425-4ff8-8294-ad2a0ccec36a" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.588746] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-938 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.588942] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-938" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.589053] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-938" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.589335] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-938" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.589627] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.590305] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.590427] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.590664] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.590838] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.591021] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 659.591336] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 659.591485] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 659.591599] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 659.591711] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 659.591817] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 659.591955] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 659.600445] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.600636] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.600942] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.601340] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.601698] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.601951] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.602518] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.602518] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.602672] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.602672] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.602759] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66f4c424-4062-4ad5-867d-4d48776176cd already deleted. [ 659.602820] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66f4c424-4062-4ad5-867d-4d48776176cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.615761] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 659.615960] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 659.616108] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 659.616476] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-938" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.616649] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-f181e7b3-c503-4e03-a10c-aea514009662 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.616823] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-f181e7b3-c503-4e03-a10c-aea514009662" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.616943] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-f181e7b3-c503-4e03-a10c-aea514009662" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.617307] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-f181e7b3-c503-4e03-a10c-aea514009662" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.617450] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f181e7b3-c503-4e03-a10c-aea514009662',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.121435] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.121835] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.121835] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.122063] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.122225] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.122386] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port f181e7b3-c503-4e03-a10c-aea514009662 not found, creating... [ 660.122798] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.123014] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.123142] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.123373] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.123512] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.123820] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.124790] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.125178] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.125592] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.125911] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.126197] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: f181e7b3-c503-4e03-a10c-aea514009662 is going to be created. [ 660.155947] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.156209] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.156436] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.156713] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.156951] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.157193] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-f181e7b3-c503-4e03-a10c-aea514009662" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.702353] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d014d213-d805-403a-bcc9-8c66da8eefa2 in Status: SUCCESS [ 660.702577] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d014d213-d805-403a-bcc9-8c66da8eefa2 deletion is rescheduled due to dependency. [ 660.702698] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.702906] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.703161] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.703421] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.703627] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.703627] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.703863] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.703913] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.705695] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d014d213-d805-403a-bcc9-8c66da8eefa2',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.124720] env[62842]: INFO networking_nsxv3.common.synchronization [None req-d4bb8d38-9ab4-4aee-b18b-911822c2ac4b None None] Enqueued Resource ID: ceb4452e-b0de-450e-88a8-52e05b4ee7c1 with Priority: HIGHEST for action port [ 661.125306] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ceb4452e-b0de-450e-88a8-52e05b4ee7c1 with Priority: HIGHEST for action port [ 661.125569] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-ceb4452e-b0de-450e-88a8-52e05b4ee7c1 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.125711] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ceb4452e-b0de-450e-88a8-52e05b4ee7c1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.125770] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ceb4452e-b0de-450e-88a8-52e05b4ee7c1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.126163] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ceb4452e-b0de-450e-88a8-52e05b4ee7c1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.128266] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ceb4452e-b0de-450e-88a8-52e05b4ee7c1',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.206767] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d014d213-d805-403a-bcc9-8c66da8eefa2',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.324745] env[62842]: INFO networking_nsxv3.common.synchronization [req-19d299f0-d9d8-47df-a9eb-bb224365d233 req-a44ecfdb-54ad-424d-902f-41887b94612d service nova] Enqueued Resource ID: 66f4c424-4062-4ad5-867d-4d48776176cd with Priority: HIGHEST for action security_group_rules [ 661.324922] env[62842]: INFO networking_nsxv3.common.synchronization [req-19d299f0-d9d8-47df-a9eb-bb224365d233 req-a44ecfdb-54ad-424d-902f-41887b94612d service nova] Enqueued Resource ID: 66f4c424-4062-4ad5-867d-4d48776176cd with Priority: HIGHEST for action security_group_members [ 661.325150] env[62842]: INFO networking_nsxv3.common.synchronization [req-19d299f0-d9d8-47df-a9eb-bb224365d233 req-a44ecfdb-54ad-424d-902f-41887b94612d service nova] Enqueued Resource ID: f181e7b3-c503-4e03-a10c-aea514009662 with Priority: HIGHEST for action port [ 661.325788] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66f4c424-4062-4ad5-867d-4d48776176cd with Priority: HIGHEST for action security_group_rules [ 661.325928] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66f4c424-4062-4ad5-867d-4d48776176cd with Priority: HIGHEST for action security_group_members [ 661.326222] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f181e7b3-c503-4e03-a10c-aea514009662 with Priority: HIGHEST for action port [ 661.326636] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66f4c424-4062-4ad5-867d-4d48776176cd taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.326863] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66f4c424-4062-4ad5-867d-4d48776176cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.328397] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66f4c424-4062-4ad5-867d-4d48776176cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.328397] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66f4c424-4062-4ad5-867d-4d48776176cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.328397] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66f4c424-4062-4ad5-867d-4d48776176cd',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.328731] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-66f4c424-4062-4ad5-867d-4d48776176cd taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.328918] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66f4c424-4062-4ad5-867d-4d48776176cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.329071] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66f4c424-4062-4ad5-867d-4d48776176cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.329362] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66f4c424-4062-4ad5-867d-4d48776176cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.330140] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.330378] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.332180] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.332180] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.332180] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.332180] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66f4c424-4062-4ad5-867d-4d48776176cd',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.337298] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-f181e7b3-c503-4e03-a10c-aea514009662 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.337444] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f181e7b3-c503-4e03-a10c-aea514009662" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.337551] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f181e7b3-c503-4e03-a10c-aea514009662" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.337797] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f181e7b3-c503-4e03-a10c-aea514009662" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.337892] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f181e7b3-c503-4e03-a10c-aea514009662',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.630498] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ceb4452e-b0de-450e-88a8-52e05b4ee7c1 [ 661.630783] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.630882] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.631053] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.631165] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.631255] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.631355] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ceb4452e-b0de-450e-88a8-52e05b4ee7c1 already deleted. [ 661.631448] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ceb4452e-b0de-450e-88a8-52e05b4ee7c1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.676804] env[62842]: INFO networking_nsxv3.common.synchronization [req-de0bb408-dc8b-4e19-9194-806dca7ced99 req-490b477e-9c02-4297-8f0f-fb1a58fc7a38 tempest-DeleteServersTestJSON-1113791748 tempest-DeleteServersTestJSON-1113791748-project-member] Enqueued Resource ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 with Priority: HIGHEST for action security_group_members [ 661.677839] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 with Priority: HIGHEST for action security_group_members [ 661.678391] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-35146777-fd28-4ac7-b454-f7dd3fbb5846 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.678841] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.679057] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.679682] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.680008] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.680241] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.680502] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.682293] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.682293] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.682293] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('35146777-fd28-4ac7-b454-f7dd3fbb5846',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.715037] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d014d213-d805-403a-bcc9-8c66da8eefa2',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.844022] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-66f4c424-4062-4ad5-867d-4d48776176cd taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.844022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66f4c424-4062-4ad5-867d-4d48776176cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.844022] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('66f4c424-4062-4ad5-867d-4d48776176cd',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.844022] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f181e7b3-c503-4e03-a10c-aea514009662 with status ACTIVE [ 661.844022] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.844022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.844022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.844022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.844022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.844022] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.844022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.844022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.844022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.844022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.844612] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.844612] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.844612] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.844612] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.844612] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.844612] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f181e7b3-c503-4e03-a10c-aea514009662 is going to be updated. [ 661.872464] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.873051] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.873051] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.873051] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.873051] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.873210] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f181e7b3-c503-4e03-a10c-aea514009662" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.162943] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-681 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.163470] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-681" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.163470] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-681" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.163834] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-681" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.165633] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.165633] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.165633] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.165878] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.166090] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.166262] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 662.166446] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 662.166744] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 662.166744] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 662.166818] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 662.166888] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 662.167027] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 662.183574] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.183833] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.183833] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.184106] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.184106] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.184849] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.184849] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.184849] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.184849] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.184849] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.184849] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 already deleted. [ 662.184849] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.189825] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 662.189987] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 662.190150] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 662.192198] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-681" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.192198] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-800e2659-0825-4e5c-b011-d3950bde5f94 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.192198] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-800e2659-0825-4e5c-b011-d3950bde5f94" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.192198] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-800e2659-0825-4e5c-b011-d3950bde5f94" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.192198] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-800e2659-0825-4e5c-b011-d3950bde5f94" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.192198] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('800e2659-0825-4e5c-b011-d3950bde5f94',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.218319] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.218529] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.218612] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.218829] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.218934] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.220084] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d014d213-d805-403a-bcc9-8c66da8eefa2 is going to be updated. [ 662.263031] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.263031] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.263031] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.263031] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.263031] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.276398] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d014d213-d805-403a-bcc9-8c66da8eefa2 in Status: IN_PROGRESS for 2s [ 662.347517] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('66f4c424-4062-4ad5-867d-4d48776176cd',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.602842] env[62842]: INFO networking_nsxv3.common.synchronization [req-09712f98-1936-4b6d-9409-612d3da75414 req-5e387919-fb8d-48a5-b2c6-81462ab461ba tempest-InstanceActionsNegativeTestJSON-1914610906 tempest-InstanceActionsNegativeTestJSON-1914610906-project-member] Enqueued Resource ID: 534d1af9-5f3d-417d-8cb4-3116f2425761 with Priority: HIGHEST for action security_group_members [ 662.604300] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 534d1af9-5f3d-417d-8cb4-3116f2425761 with Priority: HIGHEST for action security_group_members [ 662.604466] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-534d1af9-5f3d-417d-8cb4-3116f2425761 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.604550] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-534d1af9-5f3d-417d-8cb4-3116f2425761" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.604665] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-534d1af9-5f3d-417d-8cb4-3116f2425761" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.604822] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-534d1af9-5f3d-417d-8cb4-3116f2425761" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.604985] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.605117] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.605177] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.605342] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.605609] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.605609] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('534d1af9-5f3d-417d-8cb4-3116f2425761',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.695914] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.696290] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.696521] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.696888] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.697138] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.697378] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 800e2659-0825-4e5c-b011-d3950bde5f94 not found, creating... [ 662.697820] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.698036] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.698222] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.698596] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.698828] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.699335] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.699602] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.699768] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.700099] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.700290] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.700529] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 800e2659-0825-4e5c-b011-d3950bde5f94 is going to be created. [ 662.726586] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.726958] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.727201] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.727685] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.732420] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.735141] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-800e2659-0825-4e5c-b011-d3950bde5f94" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.852000] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.852000] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.852000] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.852254] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.852374] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.852433] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66f4c424-4062-4ad5-867d-4d48776176cd is going to be created. [ 662.917479] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.917709] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.917757] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.918128] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.918361] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.959805] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66f4c424-4062-4ad5-867d-4d48776176cd in Status: UNINITIALIZED for 2s [ 663.107843] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.108067] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.108167] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.108524] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.108602] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.109224] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.109224] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.109224] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.109517] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.109517] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.109610] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 534d1af9-5f3d-417d-8cb4-3116f2425761 is going to be updated. [ 663.148621] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.148621] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.148621] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.148621] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.148621] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.162114] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 534d1af9-5f3d-417d-8cb4-3116f2425761 in Status: IN_PROGRESS for 2s [ 663.611948] env[62842]: INFO networking_nsxv3.common.synchronization [req-de0bb408-dc8b-4e19-9194-806dca7ced99 req-c4b3423c-88a7-4bdd-b74d-fa9eaa5a54d3 service nova] Enqueued Resource ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 with Priority: HIGHEST for action security_group_rules [ 663.612202] env[62842]: INFO networking_nsxv3.common.synchronization [req-de0bb408-dc8b-4e19-9194-806dca7ced99 req-c4b3423c-88a7-4bdd-b74d-fa9eaa5a54d3 service nova] Enqueued Resource ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 with Priority: HIGHEST for action security_group_members [ 663.612202] env[62842]: INFO networking_nsxv3.common.synchronization [req-de0bb408-dc8b-4e19-9194-806dca7ced99 req-c4b3423c-88a7-4bdd-b74d-fa9eaa5a54d3 service nova] Enqueued Resource ID: 800e2659-0825-4e5c-b011-d3950bde5f94 with Priority: HIGHEST for action port [ 663.612774] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 with Priority: HIGHEST for action security_group_rules [ 663.612952] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 with Priority: HIGHEST for action security_group_members [ 663.613662] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 800e2659-0825-4e5c-b011-d3950bde5f94 with Priority: HIGHEST for action port [ 663.613662] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-35146777-fd28-4ac7-b454-f7dd3fbb5846 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.613662] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.613662] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.613913] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.613913] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('35146777-fd28-4ac7-b454-f7dd3fbb5846',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.616030] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-35146777-fd28-4ac7-b454-f7dd3fbb5846 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.616030] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.616030] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.616030] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.616030] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.616030] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.616030] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.616030] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.616030] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.616030] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('35146777-fd28-4ac7-b454-f7dd3fbb5846',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.617946] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-800e2659-0825-4e5c-b011-d3950bde5f94 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.620311] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-800e2659-0825-4e5c-b011-d3950bde5f94" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.620311] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-800e2659-0825-4e5c-b011-d3950bde5f94" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.620311] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-800e2659-0825-4e5c-b011-d3950bde5f94" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.620311] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('800e2659-0825-4e5c-b011-d3950bde5f94',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.805836] env[62842]: INFO networking_nsxv3.common.synchronization [None req-3d6e1438-b8af-4e4d-b410-d15ec27e4dfb None None] Enqueued Resource ID: 4602ff6d-b9e7-41d8-9453-3655af13fbf8 with Priority: HIGHEST for action port [ 663.805836] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4602ff6d-b9e7-41d8-9453-3655af13fbf8 with Priority: HIGHEST for action port [ 663.805948] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-4602ff6d-b9e7-41d8-9453-3655af13fbf8 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.806126] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4602ff6d-b9e7-41d8-9453-3655af13fbf8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.806184] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4602ff6d-b9e7-41d8-9453-3655af13fbf8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.806580] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4602ff6d-b9e7-41d8-9453-3655af13fbf8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.806674] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4602ff6d-b9e7-41d8-9453-3655af13fbf8',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.198368] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-35146777-fd28-4ac7-b454-f7dd3fbb5846 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.198368] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.198368] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('35146777-fd28-4ac7-b454-f7dd3fbb5846',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.198368] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 800e2659-0825-4e5c-b011-d3950bde5f94 with status ACTIVE [ 664.198368] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.198368] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.198368] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.198368] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.198368] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.198368] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.198368] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.198368] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.198368] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.198368] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.199823] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.199823] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.199823] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.199823] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.199823] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.199823] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 800e2659-0825-4e5c-b011-d3950bde5f94 is going to be updated. [ 664.199823] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.199823] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.199823] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.199823] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.199823] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.199823] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-800e2659-0825-4e5c-b011-d3950bde5f94" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.288857] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d014d213-d805-403a-bcc9-8c66da8eefa2 in Status: SUCCESS [ 664.290051] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.290241] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.290467] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.290664] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.290783] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.290874] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.291051] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.291134] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.291219] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.291310] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d014d213-d805-403a-bcc9-8c66da8eefa2',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.309997] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4602ff6d-b9e7-41d8-9453-3655af13fbf8 [ 664.310238] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.310368] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.310436] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.310642] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.310734] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.310828] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4602ff6d-b9e7-41d8-9453-3655af13fbf8 already deleted. [ 664.310925] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4602ff6d-b9e7-41d8-9453-3655af13fbf8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.628888] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('35146777-fd28-4ac7-b454-f7dd3fbb5846',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.793612] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-d014d213-d805-403a-bcc9-8c66da8eefa2 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.793953] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.794063] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.794373] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.794559] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.794719] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.794776] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.794943] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.795093] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.795217] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.795414] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-d014d213-d805-403a-bcc9-8c66da8eefa2 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.795531] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.795591] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.795802] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.795949] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.796040] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.796103] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.796242] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.796320] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.796397] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.796491] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d014d213-d805-403a-bcc9-8c66da8eefa2',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.974826] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66f4c424-4062-4ad5-867d-4d48776176cd in Status: SUCCESS [ 664.975441] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66f4c424-4062-4ad5-867d-4d48776176cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.975441] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66f4c424-4062-4ad5-867d-4d48776176cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.975568] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66f4c424-4062-4ad5-867d-4d48776176cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.975729] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.975859] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.975923] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.976088] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.976190] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.976274] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66f4c424-4062-4ad5-867d-4d48776176cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.976364] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('66f4c424-4062-4ad5-867d-4d48776176cd',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.133753] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.134075] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.134290] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.134552] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.134659] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.134824] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 is going to be created. [ 665.175900] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.176170] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.176274] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.176741] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.176854] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.181672] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 534d1af9-5f3d-417d-8cb4-3116f2425761 in Status: SUCCESS [ 665.181993] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 534d1af9-5f3d-417d-8cb4-3116f2425761 deletion is rescheduled due to dependency. [ 665.182222] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-534d1af9-5f3d-417d-8cb4-3116f2425761" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.197574] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 in Status: UNINITIALIZED for 2s [ 665.211528] env[62842]: INFO networking_nsxv3.common.synchronization [None req-60701bdd-f64b-4ce4-9ee8-93f29d1dfd70 tempest-MigrationsAdminTest-2116750055 tempest-MigrationsAdminTest-2116750055-project-member] Enqueued Resource ID: 8ca54231-77c9-4cfa-997a-1dbc16cc1abd with Priority: HIGHEST for action security_group_rules [ 665.212074] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ca54231-77c9-4cfa-997a-1dbc16cc1abd with Priority: HIGHEST for action security_group_rules [ 665.212897] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8ca54231-77c9-4cfa-997a-1dbc16cc1abd taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.214905] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8ca54231-77c9-4cfa-997a-1dbc16cc1abd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.214905] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8ca54231-77c9-4cfa-997a-1dbc16cc1abd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.214905] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8ca54231-77c9-4cfa-997a-1dbc16cc1abd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.214905] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8ca54231-77c9-4cfa-997a-1dbc16cc1abd',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.301590] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d014d213-d805-403a-bcc9-8c66da8eefa2: rpc.has_security_group_logging(os_id): False [ 665.322109] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.322109] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.322109] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.322447] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.322999] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.322999] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.322999] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.322999] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.323907] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.323907] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.324119] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.324357] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.324422] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.324578] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.324660] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.324878] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.324971] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.325044] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.325193] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.325266] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.325354] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d014d213-d805-403a-bcc9-8c66da8eefa2 is going to be updated. [ 665.342961] env[62842]: INFO networking_nsxv3.common.synchronization [None req-6e948916-21f9-43e0-bd28-8c8c29a5c3e4 tempest-MigrationsAdminTest-2116750055 tempest-MigrationsAdminTest-2116750055-project-member] Enqueued Resource ID: 8ca54231-77c9-4cfa-997a-1dbc16cc1abd with Priority: HIGHEST for action security_group_rules [ 665.343887] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ca54231-77c9-4cfa-997a-1dbc16cc1abd with Priority: HIGHEST for action security_group_rules [ 665.344234] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8ca54231-77c9-4cfa-997a-1dbc16cc1abd taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.344337] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8ca54231-77c9-4cfa-997a-1dbc16cc1abd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.410391] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.410391] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.410683] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.410927] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.411218] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.435023] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d014d213-d805-403a-bcc9-8c66da8eefa2 in Status: IN_PROGRESS for 2s [ 665.480166] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-66f4c424-4062-4ad5-867d-4d48776176cd taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.480406] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66f4c424-4062-4ad5-867d-4d48776176cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.480406] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66f4c424-4062-4ad5-867d-4d48776176cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.481073] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66f4c424-4062-4ad5-867d-4d48776176cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.481330] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.481561] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.481660] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.482602] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.482602] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.482602] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66f4c424-4062-4ad5-867d-4d48776176cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.482602] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-66f4c424-4062-4ad5-867d-4d48776176cd taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.482602] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66f4c424-4062-4ad5-867d-4d48776176cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.482602] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66f4c424-4062-4ad5-867d-4d48776176cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.482602] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66f4c424-4062-4ad5-867d-4d48776176cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.483173] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.483173] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.483173] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.483173] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.483173] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.483173] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66f4c424-4062-4ad5-867d-4d48776176cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.483465] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('66f4c424-4062-4ad5-867d-4d48776176cd',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.736176] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.736846] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.737041] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.737654] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.737962] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.739185] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8ca54231-77c9-4cfa-997a-1dbc16cc1abd already deleted. [ 665.739372] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8ca54231-77c9-4cfa-997a-1dbc16cc1abd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.739643] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8ca54231-77c9-4cfa-997a-1dbc16cc1abd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.740790] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8ca54231-77c9-4cfa-997a-1dbc16cc1abd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.741623] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8ca54231-77c9-4cfa-997a-1dbc16cc1abd',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.987061] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 66f4c424-4062-4ad5-867d-4d48776176cd: rpc.has_security_group_logging(os_id): False [ 666.008445] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.009391] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.009785] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.010648] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.011086] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.011569] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.011705] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.011777] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.011964] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.012110] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.012414] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.012557] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.012644] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.012840] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.013034] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.013245] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.013406] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.013517] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.013748] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.013977] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.014135] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66f4c424-4062-4ad5-867d-4d48776176cd is going to be created. [ 666.087774] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.087774] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.088054] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.088219] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.088716] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.105501] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66f4c424-4062-4ad5-867d-4d48776176cd in Status: IN_PROGRESS for 2s [ 666.271950] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.272211] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.272332] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.272689] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.273089] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.273089] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8ca54231-77c9-4cfa-997a-1dbc16cc1abd already deleted. [ 666.273195] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8ca54231-77c9-4cfa-997a-1dbc16cc1abd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.209316] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 in Status: SUCCESS [ 667.209628] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.209791] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.210019] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.210224] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.210339] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.210403] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.210551] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.210635] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.210719] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.210866] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('35146777-fd28-4ac7-b454-f7dd3fbb5846',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.450266] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d014d213-d805-403a-bcc9-8c66da8eefa2 in Status: SUCCESS [ 667.450582] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.713325] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-35146777-fd28-4ac7-b454-f7dd3fbb5846 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.713491] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.713596] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.713793] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.713968] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.714082] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.714138] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.714292] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.714381] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.714480] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.714635] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-35146777-fd28-4ac7-b454-f7dd3fbb5846 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.714730] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.714789] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.714995] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.715165] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.715265] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.715351] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.715537] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.715620] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.715709] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.715800] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('35146777-fd28-4ac7-b454-f7dd3fbb5846',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.124034] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66f4c424-4062-4ad5-867d-4d48776176cd in Status: SUCCESS [ 668.124196] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66f4c424-4062-4ad5-867d-4d48776176cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.218481] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 35146777-fd28-4ac7-b454-f7dd3fbb5846: rpc.has_security_group_logging(os_id): False [ 668.239382] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.239672] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.239672] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.239809] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.239944] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.240112] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.240262] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.240262] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.240425] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.240501] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.240690] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.240812] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.240887] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.241077] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.241077] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.241220] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.241325] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.241398] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.241504] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.241582] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.241650] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 is going to be created. [ 668.314242] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.314461] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.314615] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.314880] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.315169] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.328074] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 in Status: IN_PROGRESS for 2s [ 670.344873] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 670.345186] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 670.348069] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 in Status: SUCCESS [ 670.348369] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.170850] env[62842]: INFO networking_nsxv3.common.synchronization [req-1fa83450-c43d-4b40-9519-6cc477fa7cde req-85d15258-fd67-4e49-9a2e-5837000e5bbd tempest-SecurityGroupsTestJSON-1354345429 tempest-SecurityGroupsTestJSON-1354345429-project-member] Enqueued Resource ID: 5704e4e3-8211-4e30-b474-06c668cf060d with Priority: HIGHEST for action security_group_members [ 673.171627] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5704e4e3-8211-4e30-b474-06c668cf060d with Priority: HIGHEST for action security_group_members [ 673.172130] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5704e4e3-8211-4e30-b474-06c668cf060d taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.172259] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.172327] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.172536] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.172702] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.172897] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.172996] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.173216] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.173305] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.173398] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5704e4e3-8211-4e30-b474-06c668cf060d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.487427] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-594 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.487573] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-594" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.487735] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-594" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.488060] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-594" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.488353] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.488615] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.488823] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.489504] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.489749] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.489977] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 673.490129] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 673.490242] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 673.490349] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 673.490459] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 673.490563] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 673.490693] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 673.512962] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 673.513163] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 673.513309] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 673.513415] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-594" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.513869] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-8bb59813-9416-43bc-8d12-a122bdfa415e taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.514078] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-8bb59813-9416-43bc-8d12-a122bdfa415e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.514202] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-8bb59813-9416-43bc-8d12-a122bdfa415e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.514526] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-8bb59813-9416-43bc-8d12-a122bdfa415e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.514665] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8bb59813-9416-43bc-8d12-a122bdfa415e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.676165] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5704e4e3-8211-4e30-b474-06c668cf060d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.017289] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.017523] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.017648] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.017944] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.018142] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.018306] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 8bb59813-9416-43bc-8d12-a122bdfa415e not found, creating... [ 674.018592] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.018781] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.018894] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.019139] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.019280] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.019898] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.020083] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.020200] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.020406] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.020539] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.020673] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 8bb59813-9416-43bc-8d12-a122bdfa415e is going to be created. [ 674.042376] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.042651] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.042831] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.043162] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.043441] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.043704] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-8bb59813-9416-43bc-8d12-a122bdfa415e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.179157] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5704e4e3-8211-4e30-b474-06c668cf060d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.682057] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.682339] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.682339] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.682504] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.682595] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.682696] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5704e4e3-8211-4e30-b474-06c668cf060d is going to be updated. [ 674.720160] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.720381] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.721428] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.721428] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.721428] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.745051] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5704e4e3-8211-4e30-b474-06c668cf060d in Status: IN_PROGRESS for 2s [ 674.925400] env[62842]: INFO networking_nsxv3.common.synchronization [req-1fa83450-c43d-4b40-9519-6cc477fa7cde req-4cffca3d-2af6-4867-8031-0684a07ae962 service nova] Enqueued Resource ID: 5704e4e3-8211-4e30-b474-06c668cf060d with Priority: HIGHEST for action security_group_rules [ 674.925686] env[62842]: INFO networking_nsxv3.common.synchronization [req-1fa83450-c43d-4b40-9519-6cc477fa7cde req-4cffca3d-2af6-4867-8031-0684a07ae962 service nova] Enqueued Resource ID: 5704e4e3-8211-4e30-b474-06c668cf060d with Priority: HIGHEST for action security_group_members [ 674.925871] env[62842]: INFO networking_nsxv3.common.synchronization [req-1fa83450-c43d-4b40-9519-6cc477fa7cde req-4cffca3d-2af6-4867-8031-0684a07ae962 service nova] Enqueued Resource ID: 8bb59813-9416-43bc-8d12-a122bdfa415e with Priority: HIGHEST for action port [ 674.926157] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5704e4e3-8211-4e30-b474-06c668cf060d with Priority: HIGHEST for action security_group_rules [ 674.926293] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5704e4e3-8211-4e30-b474-06c668cf060d with Priority: HIGHEST for action security_group_members [ 674.926386] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bb59813-9416-43bc-8d12-a122bdfa415e with Priority: HIGHEST for action port [ 674.928768] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5704e4e3-8211-4e30-b474-06c668cf060d taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.928915] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.929088] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.929944] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.930095] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5704e4e3-8211-4e30-b474-06c668cf060d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.931878] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5704e4e3-8211-4e30-b474-06c668cf060d taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.931984] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.932212] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-8bb59813-9416-43bc-8d12-a122bdfa415e taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.932314] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8bb59813-9416-43bc-8d12-a122bdfa415e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.932373] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8bb59813-9416-43bc-8d12-a122bdfa415e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.932566] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8bb59813-9416-43bc-8d12-a122bdfa415e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.932641] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8bb59813-9416-43bc-8d12-a122bdfa415e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.435784] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5704e4e3-8211-4e30-b474-06c668cf060d taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.435784] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.436178] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8bb59813-9416-43bc-8d12-a122bdfa415e with status ACTIVE [ 675.436178] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.436178] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.436178] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.436392] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.437444] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.437444] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.437444] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.437444] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.437444] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.437444] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.437444] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.437444] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.437444] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.438137] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.438137] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.438137] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8bb59813-9416-43bc-8d12-a122bdfa415e is going to be updated. [ 675.460782] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.460942] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.461018] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.462049] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.462280] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.462525] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8bb59813-9416-43bc-8d12-a122bdfa415e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.759195] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5704e4e3-8211-4e30-b474-06c668cf060d in Status: SUCCESS [ 676.759509] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.759660] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.760041] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.760263] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.760400] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.760467] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.760663] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.760725] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.760823] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5704e4e3-8211-4e30-b474-06c668cf060d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.267439] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5704e4e3-8211-4e30-b474-06c668cf060d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.706408] env[62842]: INFO networking_nsxv3.common.synchronization [req-45c24f55-3762-4e9a-b94e-948faf20048b req-cf234d59-235e-4698-aeef-81317c1ce483 tempest-DeleteServersAdminTestJSON-2057441283 tempest-DeleteServersAdminTestJSON-2057441283-project-member] Enqueued Resource ID: d014d213-d805-403a-bcc9-8c66da8eefa2 with Priority: HIGHEST for action security_group_members [ 677.707832] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d014d213-d805-403a-bcc9-8c66da8eefa2 with Priority: HIGHEST for action security_group_members [ 677.711022] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-d014d213-d805-403a-bcc9-8c66da8eefa2 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.711022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.711022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.711022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.711022] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.711022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.711022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.711022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.711022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.711022] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d014d213-d805-403a-bcc9-8c66da8eefa2',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.769896] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5704e4e3-8211-4e30-b474-06c668cf060d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.088941] env[62842]: INFO networking_nsxv3.common.synchronization [req-2bc63aed-6e89-4164-9e32-08b68398c7fe req-2583f3c2-79db-4349-a0e4-49fc2eadba2f tempest-ListServersNegativeTestJSON-2108045219 tempest-ListServersNegativeTestJSON-2108045219-project-member] Enqueued Resource ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 with Priority: HIGHEST for action security_group_members [ 678.089510] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 with Priority: HIGHEST for action security_group_members [ 678.090117] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a595937-aa58-40f8-a3cf-b57a814011e8 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.090117] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.090285] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.090416] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.090569] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.090668] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.090726] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.091826] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.091826] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.091826] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a595937-aa58-40f8-a3cf-b57a814011e8',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.215162] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.215162] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.215162] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.215162] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.215162] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.215162] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.215162] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.215162] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.215162] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.216561] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.216561] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d014d213-d805-403a-bcc9-8c66da8eefa2 is going to be updated. [ 678.254931] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.254931] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.254931] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.254931] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.254931] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.264470] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d014d213-d805-403a-bcc9-8c66da8eefa2 in Status: IN_PROGRESS for 2s [ 678.274765] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.274765] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.274765] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.274765] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.274765] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.274765] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5704e4e3-8211-4e30-b474-06c668cf060d is going to be updated. [ 678.308929] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.309122] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.309167] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.309713] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.309713] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.323614] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5704e4e3-8211-4e30-b474-06c668cf060d in Status: IN_PROGRESS for 2s [ 678.593517] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.593663] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.593732] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.593949] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.594051] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.594247] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.594338] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.594392] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.594540] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.594605] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.594691] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 already deleted. [ 678.594797] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.017169] env[62842]: INFO networking_nsxv3.common.synchronization [req-438eb3de-e39e-4643-b55d-7acea9e1fe41 req-5e8361e4-8bc3-4e0a-9115-209bf0406c07 tempest-ListServerFiltersTestJSON-2112811092 tempest-ListServerFiltersTestJSON-2112811092-project-member] Enqueued Resource ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 with Priority: HIGHEST for action security_group_members [ 679.017792] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 with Priority: HIGHEST for action security_group_members [ 679.018569] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-331dd47d-e3b4-4338-b588-cd456a9aa5f7 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.019151] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.019395] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.019729] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.019986] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.020130] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.020193] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.020391] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.020500] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.020606] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('331dd47d-e3b4-4338-b588-cd456a9aa5f7',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.061610] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-81 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.061825] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-81" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.062027] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-81" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.062395] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-81" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.062667] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.062866] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.062997] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.063822] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.064047] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.064296] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 679.064661] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 679.064661] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 679.064661] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 679.064800] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 679.064917] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 679.065078] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 679.087305] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 679.087519] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 679.087703] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 679.087848] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-81" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.088204] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-389f6bb3-09b1-4619-94d6-83b7a3dcc7c0 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.088375] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-389f6bb3-09b1-4619-94d6-83b7a3dcc7c0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.088489] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-389f6bb3-09b1-4619-94d6-83b7a3dcc7c0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.088875] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-389f6bb3-09b1-4619-94d6-83b7a3dcc7c0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.089160] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('389f6bb3-09b1-4619-94d6-83b7a3dcc7c0',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.523504] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('331dd47d-e3b4-4338-b588-cd456a9aa5f7',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.593729] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.593972] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.594166] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.594377] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.594530] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.594682] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 389f6bb3-09b1-4619-94d6-83b7a3dcc7c0 not found, creating... [ 679.594955] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.595158] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.595279] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.595503] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.596816] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.597227] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.597452] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.597697] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.598025] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.598229] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.598414] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 389f6bb3-09b1-4619-94d6-83b7a3dcc7c0 is going to be created. [ 679.600331] env[62842]: INFO networking_nsxv3.common.synchronization [req-b45ccb97-7f0e-4033-b50c-eb5ce5a1e1e5 req-fa677e73-ca34-486b-a8e0-b81f243d8922 tempest-DeleteServersTestJSON-1113791748 tempest-DeleteServersTestJSON-1113791748-project-member] Enqueued Resource ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 with Priority: HIGHEST for action security_group_members [ 679.601130] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 with Priority: HIGHEST for action security_group_members [ 679.601858] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-35146777-fd28-4ac7-b454-f7dd3fbb5846 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.602038] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.602118] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.602357] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.602585] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.602715] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.602783] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.602964] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.603064] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.603174] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('35146777-fd28-4ac7-b454-f7dd3fbb5846',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.624644] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.625021] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.625021] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.625294] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.625479] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.625700] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-389f6bb3-09b1-4619-94d6-83b7a3dcc7c0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.669337] env[62842]: INFO networking_nsxv3.common.synchronization [req-5f0a2919-e759-4286-806f-57a45c2f8ae4 req-8d5e2449-24b0-4660-9153-fae515067943 tempest-ServerDiagnosticsNegativeTest-466073960 tempest-ServerDiagnosticsNegativeTest-466073960-project-member] Enqueued Resource ID: 66f4c424-4062-4ad5-867d-4d48776176cd with Priority: HIGHEST for action security_group_members [ 679.669983] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66f4c424-4062-4ad5-867d-4d48776176cd with Priority: HIGHEST for action security_group_members [ 679.672291] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-66f4c424-4062-4ad5-867d-4d48776176cd taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.672448] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66f4c424-4062-4ad5-867d-4d48776176cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.672521] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66f4c424-4062-4ad5-867d-4d48776176cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.672735] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66f4c424-4062-4ad5-867d-4d48776176cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.672935] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.673219] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.673219] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.673349] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.673428] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.673523] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66f4c424-4062-4ad5-867d-4d48776176cd',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.025978] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('331dd47d-e3b4-4338-b588-cd456a9aa5f7',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.106510] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.106997] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.106997] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.106997] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.107224] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.107270] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.107357] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.107502] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.107559] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.107614] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.107706] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 is going to be updated. [ 680.140447] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.141422] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.141870] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.141870] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.142827] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.153278] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 in Status: IN_PROGRESS for 2s [ 680.178683] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.178683] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.178683] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.178683] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.178683] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.178683] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.178683] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.178683] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.178683] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.178683] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.178683] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66f4c424-4062-4ad5-867d-4d48776176cd is going to be updated. [ 680.213398] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.213590] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.213672] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.213976] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.214156] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.228327] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66f4c424-4062-4ad5-867d-4d48776176cd in Status: IN_PROGRESS for 2s [ 680.274910] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d014d213-d805-403a-bcc9-8c66da8eefa2 in Status: SUCCESS [ 680.275237] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d014d213-d805-403a-bcc9-8c66da8eefa2 deletion is rescheduled due to dependency. [ 680.275291] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.341172] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5704e4e3-8211-4e30-b474-06c668cf060d in Status: SUCCESS [ 680.341172] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.341172] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.341172] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.341172] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.341172] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.341172] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.341172] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.341172] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.341172] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.341172] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5704e4e3-8211-4e30-b474-06c668cf060d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.528303] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.528452] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.528521] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.528793] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.528887] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.528987] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 is going to be updated. [ 680.564378] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.564519] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.564591] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.564796] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.564937] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.574170] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 in Status: IN_PROGRESS for 2s [ 680.842928] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5704e4e3-8211-4e30-b474-06c668cf060d taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.843269] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.843269] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.843394] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.843590] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.843694] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.843882] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.844129] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.844242] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.844346] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.844494] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5704e4e3-8211-4e30-b474-06c668cf060d taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.844578] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.844670] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.844815] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.844952] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.845072] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.845184] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.845345] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.845423] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.845503] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.845592] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5704e4e3-8211-4e30-b474-06c668cf060d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.946824] env[62842]: INFO networking_nsxv3.common.synchronization [req-2bc63aed-6e89-4164-9e32-08b68398c7fe req-c5987f5b-7ba1-4cd4-aa60-42a44eae2ad0 service nova] Enqueued Resource ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 with Priority: HIGHEST for action security_group_rules [ 680.947106] env[62842]: INFO networking_nsxv3.common.synchronization [req-2bc63aed-6e89-4164-9e32-08b68398c7fe req-c5987f5b-7ba1-4cd4-aa60-42a44eae2ad0 service nova] Enqueued Resource ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 with Priority: HIGHEST for action security_group_members [ 680.947256] env[62842]: INFO networking_nsxv3.common.synchronization [req-2bc63aed-6e89-4164-9e32-08b68398c7fe req-c5987f5b-7ba1-4cd4-aa60-42a44eae2ad0 service nova] Enqueued Resource ID: 389f6bb3-09b1-4619-94d6-83b7a3dcc7c0 with Priority: HIGHEST for action port [ 680.947820] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 with Priority: HIGHEST for action security_group_rules [ 680.947964] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 with Priority: HIGHEST for action security_group_members [ 680.948221] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 389f6bb3-09b1-4619-94d6-83b7a3dcc7c0 with Priority: HIGHEST for action port [ 680.948583] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a595937-aa58-40f8-a3cf-b57a814011e8 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.948730] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.948801] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.949124] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.949210] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a595937-aa58-40f8-a3cf-b57a814011e8',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.950103] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a595937-aa58-40f8-a3cf-b57a814011e8 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.950215] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.950279] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.950455] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.952121] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.952984] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.953099] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.953293] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.953386] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.953480] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a595937-aa58-40f8-a3cf-b57a814011e8',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.954398] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-389f6bb3-09b1-4619-94d6-83b7a3dcc7c0 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.954527] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-389f6bb3-09b1-4619-94d6-83b7a3dcc7c0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.954606] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-389f6bb3-09b1-4619-94d6-83b7a3dcc7c0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.954807] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-389f6bb3-09b1-4619-94d6-83b7a3dcc7c0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.954900] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('389f6bb3-09b1-4619-94d6-83b7a3dcc7c0',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.160366] env[62842]: INFO networking_nsxv3.common.synchronization [req-2bc63aed-6e89-4164-9e32-08b68398c7fe req-23c7030f-767f-48f6-8dee-0aa16199c804 tempest-ListServersNegativeTestJSON-2108045219 tempest-ListServersNegativeTestJSON-2108045219-project-member] Enqueued Resource ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 with Priority: HIGHEST for action security_group_members [ 681.160906] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 with Priority: HIGHEST for action security_group_members [ 681.162024] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a595937-aa58-40f8-a3cf-b57a814011e8 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.162024] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.348856] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5704e4e3-8211-4e30-b474-06c668cf060d: rpc.has_security_group_logging(os_id): False [ 681.371127] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.371127] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.371127] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.371127] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.371127] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.371127] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.371127] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.371127] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.371127] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.371127] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.371127] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.371127] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.371127] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.371127] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.371127] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.371884] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.371884] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.372149] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.372413] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.372579] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.372765] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5704e4e3-8211-4e30-b474-06c668cf060d is going to be updated. [ 681.440935] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.440935] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.440935] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.440935] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.440935] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.458702] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5704e4e3-8211-4e30-b474-06c668cf060d in Status: IN_PROGRESS for 2s [ 681.458702] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3a595937-aa58-40f8-a3cf-b57a814011e8',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.458702] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a595937-aa58-40f8-a3cf-b57a814011e8 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.458702] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.458702] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 389f6bb3-09b1-4619-94d6-83b7a3dcc7c0 with status ACTIVE [ 681.458702] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.458702] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.458702] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.459153] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.460261] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.460261] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.460261] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.460448] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.460528] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.460557] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.460724] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.460821] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.460884] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.461047] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.461125] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.461211] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 389f6bb3-09b1-4619-94d6-83b7a3dcc7c0 is going to be updated. [ 681.501709] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.501964] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.501964] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.502165] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.502672] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.502672] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-389f6bb3-09b1-4619-94d6-83b7a3dcc7c0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.649752] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-81 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.649953] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-81" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.650094] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-81" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.650433] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-81" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.650775] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.650946] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.651102] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.651329] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.651496] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.652927] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 681.653058] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 681.653248] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 681.653356] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 681.653497] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 681.653610] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 681.653768] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 681.676216] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 681.676530] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 681.676710] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 681.676858] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-81" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.677564] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-4e3b5ca2-a822-421f-856f-b8f3c2682a39 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.677762] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-4e3b5ca2-a822-421f-856f-b8f3c2682a39" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.677883] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-4e3b5ca2-a822-421f-856f-b8f3c2682a39" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.678245] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-4e3b5ca2-a822-421f-856f-b8f3c2682a39" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.679114] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e3b5ca2-a822-421f-856f-b8f3c2682a39',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.965413] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3a595937-aa58-40f8-a3cf-b57a814011e8',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.163878] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 in Status: SUCCESS [ 682.164175] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 deletion is rescheduled due to dependency. [ 682.164456] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.182382] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.182382] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.182382] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.182382] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.182382] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.182700] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 4e3b5ca2-a822-421f-856f-b8f3c2682a39 not found, creating... [ 682.184131] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.184131] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.184131] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.184131] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.184131] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.184131] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.184131] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.186070] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.186144] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.186290] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.186750] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 4e3b5ca2-a822-421f-856f-b8f3c2682a39 is going to be created. [ 682.208090] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.208353] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.208455] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.209633] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.209997] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.210341] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-4e3b5ca2-a822-421f-856f-b8f3c2682a39" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.241517] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66f4c424-4062-4ad5-867d-4d48776176cd in Status: SUCCESS [ 682.241661] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66f4c424-4062-4ad5-867d-4d48776176cd deletion is rescheduled due to dependency. [ 682.241818] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66f4c424-4062-4ad5-867d-4d48776176cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.468557] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.468767] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.468842] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.469036] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.469300] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.469300] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 is going to be created. [ 682.497064] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.497235] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.497275] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.497561] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.497693] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.513207] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 in Status: UNINITIALIZED for 2s [ 682.587069] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 in Status: SUCCESS [ 682.587069] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.091468] env[62842]: INFO networking_nsxv3.common.synchronization [req-2bc63aed-6e89-4164-9e32-08b68398c7fe req-479374b9-ef2b-4c25-b0c2-559a49e04e8e service nova] Enqueued Resource ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 with Priority: HIGHEST for action security_group_rules [ 683.091760] env[62842]: INFO networking_nsxv3.common.synchronization [req-2bc63aed-6e89-4164-9e32-08b68398c7fe req-479374b9-ef2b-4c25-b0c2-559a49e04e8e service nova] Enqueued Resource ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 with Priority: HIGHEST for action security_group_members [ 683.091842] env[62842]: INFO networking_nsxv3.common.synchronization [req-2bc63aed-6e89-4164-9e32-08b68398c7fe req-479374b9-ef2b-4c25-b0c2-559a49e04e8e service nova] Enqueued Resource ID: 4e3b5ca2-a822-421f-856f-b8f3c2682a39 with Priority: HIGHEST for action port [ 683.092020] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 with Priority: HIGHEST for action security_group_rules [ 683.092157] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 with Priority: HIGHEST for action security_group_members [ 683.092283] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e3b5ca2-a822-421f-856f-b8f3c2682a39 with Priority: HIGHEST for action port [ 683.092808] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a595937-aa58-40f8-a3cf-b57a814011e8 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.092911] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.094185] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a595937-aa58-40f8-a3cf-b57a814011e8 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.094288] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.094472] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e3b5ca2-a822-421f-856f-b8f3c2682a39 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.094568] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e3b5ca2-a822-421f-856f-b8f3c2682a39" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.094627] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e3b5ca2-a822-421f-856f-b8f3c2682a39" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.094822] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e3b5ca2-a822-421f-856f-b8f3c2682a39" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.094896] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e3b5ca2-a822-421f-856f-b8f3c2682a39',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.144041] env[62842]: INFO networking_nsxv3.common.synchronization [None req-9b41ab09-486b-4ae0-8f34-aa12e330947b None None] Enqueued Resource ID: 009038a4-1eb4-45c8-8c05-a93df811f7dd with Priority: HIGHEST for action port [ 683.144041] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 009038a4-1eb4-45c8-8c05-a93df811f7dd with Priority: HIGHEST for action port [ 683.144041] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-009038a4-1eb4-45c8-8c05-a93df811f7dd taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.144041] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-009038a4-1eb4-45c8-8c05-a93df811f7dd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.144041] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-009038a4-1eb4-45c8-8c05-a93df811f7dd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.144041] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-009038a4-1eb4-45c8-8c05-a93df811f7dd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.145711] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('009038a4-1eb4-45c8-8c05-a93df811f7dd',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.475545] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5704e4e3-8211-4e30-b474-06c668cf060d in Status: SUCCESS [ 683.475944] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.597711] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4e3b5ca2-a822-421f-856f-b8f3c2682a39 with status ACTIVE [ 683.598673] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.599185] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.599185] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.599525] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.599747] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.600606] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.600606] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.600606] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.601302] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.601302] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.601302] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.601302] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.602354] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.602354] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.602354] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.602354] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4e3b5ca2-a822-421f-856f-b8f3c2682a39 is going to be updated. [ 683.630292] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.630513] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.630513] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.630864] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.630864] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.631071] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e3b5ca2-a822-421f-856f-b8f3c2682a39" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.648520] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 009038a4-1eb4-45c8-8c05-a93df811f7dd [ 683.648852] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.648852] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.649174] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.649174] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.649327] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.649395] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:009038a4-1eb4-45c8-8c05-a93df811f7dd already deleted. [ 683.649460] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-009038a4-1eb4-45c8-8c05-a93df811f7dd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.023644] env[62842]: INFO networking_nsxv3.common.synchronization [req-a6c85445-8f9f-4c34-a84c-9ffff21f60d5 req-01feb150-3f12-40e5-9856-053fa3fd8a2d tempest-SecurityGroupsTestJSON-1354345429 tempest-SecurityGroupsTestJSON-1354345429-project-member] Enqueued Resource ID: 5704e4e3-8211-4e30-b474-06c668cf060d with Priority: HIGHEST for action security_group_members [ 684.023644] env[62842]: INFO networking_nsxv3.common.synchronization [req-a6c85445-8f9f-4c34-a84c-9ffff21f60d5 req-01feb150-3f12-40e5-9856-053fa3fd8a2d tempest-SecurityGroupsTestJSON-1354345429 tempest-SecurityGroupsTestJSON-1354345429-project-member] Enqueued Resource ID: 626f4e51-c3dc-4318-acdd-bb61945d5f1f with Priority: HIGHEST for action security_group_members [ 684.023644] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5704e4e3-8211-4e30-b474-06c668cf060d with Priority: HIGHEST for action security_group_members [ 684.023644] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 626f4e51-c3dc-4318-acdd-bb61945d5f1f with Priority: HIGHEST for action security_group_members [ 684.023644] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5704e4e3-8211-4e30-b474-06c668cf060d taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.023644] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.023644] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.023644] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.024324] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.024324] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.024324] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.024324] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.024324] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.024324] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5704e4e3-8211-4e30-b474-06c668cf060d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.026143] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-626f4e51-c3dc-4318-acdd-bb61945d5f1f taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.026143] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-626f4e51-c3dc-4318-acdd-bb61945d5f1f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.026143] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-626f4e51-c3dc-4318-acdd-bb61945d5f1f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.026143] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-626f4e51-c3dc-4318-acdd-bb61945d5f1f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.026143] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.026143] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.026380] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.026909] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.026999] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.027120] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('626f4e51-c3dc-4318-acdd-bb61945d5f1f',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.093382] env[62842]: INFO networking_nsxv3.common.synchronization [req-a6c85445-8f9f-4c34-a84c-9ffff21f60d5 req-01feb150-3f12-40e5-9856-053fa3fd8a2d tempest-SecurityGroupsTestJSON-1354345429 tempest-SecurityGroupsTestJSON-1354345429-project-member] Enqueued Resource ID: 5704e4e3-8211-4e30-b474-06c668cf060d with Priority: HIGHEST for action security_group_rules [ 684.094061] env[62842]: INFO networking_nsxv3.common.synchronization [req-a6c85445-8f9f-4c34-a84c-9ffff21f60d5 req-01feb150-3f12-40e5-9856-053fa3fd8a2d tempest-SecurityGroupsTestJSON-1354345429 tempest-SecurityGroupsTestJSON-1354345429-project-member] Enqueued Resource ID: 5704e4e3-8211-4e30-b474-06c668cf060d with Priority: HIGHEST for action security_group_members [ 684.094318] env[62842]: INFO networking_nsxv3.common.synchronization [req-a6c85445-8f9f-4c34-a84c-9ffff21f60d5 req-01feb150-3f12-40e5-9856-053fa3fd8a2d tempest-SecurityGroupsTestJSON-1354345429 tempest-SecurityGroupsTestJSON-1354345429-project-member] Enqueued Resource ID: 626f4e51-c3dc-4318-acdd-bb61945d5f1f with Priority: HIGHEST for action security_group_rules [ 684.095036] env[62842]: INFO networking_nsxv3.common.synchronization [req-a6c85445-8f9f-4c34-a84c-9ffff21f60d5 req-01feb150-3f12-40e5-9856-053fa3fd8a2d tempest-SecurityGroupsTestJSON-1354345429 tempest-SecurityGroupsTestJSON-1354345429-project-member] Enqueued Resource ID: 626f4e51-c3dc-4318-acdd-bb61945d5f1f with Priority: HIGHEST for action security_group_members [ 684.095036] env[62842]: INFO networking_nsxv3.common.synchronization [req-a6c85445-8f9f-4c34-a84c-9ffff21f60d5 req-01feb150-3f12-40e5-9856-053fa3fd8a2d tempest-SecurityGroupsTestJSON-1354345429 tempest-SecurityGroupsTestJSON-1354345429-project-member] Enqueued Resource ID: 8bb59813-9416-43bc-8d12-a122bdfa415e with Priority: HIGHEST for action port [ 684.095756] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5704e4e3-8211-4e30-b474-06c668cf060d with Priority: HIGHEST for action security_group_rules [ 684.096159] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 626f4e51-c3dc-4318-acdd-bb61945d5f1f with Priority: HIGHEST for action security_group_rules [ 684.099077] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bb59813-9416-43bc-8d12-a122bdfa415e with Priority: HIGHEST for action port [ 684.099077] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5704e4e3-8211-4e30-b474-06c668cf060d with Priority: HIGHEST for action security_group_members [ 684.099077] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 626f4e51-c3dc-4318-acdd-bb61945d5f1f with Priority: HIGHEST for action security_group_members [ 684.099077] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5704e4e3-8211-4e30-b474-06c668cf060d taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.099077] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.099077] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.099077] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.099077] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5704e4e3-8211-4e30-b474-06c668cf060d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.099077] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-626f4e51-c3dc-4318-acdd-bb61945d5f1f taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.099077] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-626f4e51-c3dc-4318-acdd-bb61945d5f1f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.099077] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-626f4e51-c3dc-4318-acdd-bb61945d5f1f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.099077] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-626f4e51-c3dc-4318-acdd-bb61945d5f1f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.099077] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('626f4e51-c3dc-4318-acdd-bb61945d5f1f',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.104167] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-8bb59813-9416-43bc-8d12-a122bdfa415e taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.104494] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8bb59813-9416-43bc-8d12-a122bdfa415e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.104723] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8bb59813-9416-43bc-8d12-a122bdfa415e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.105032] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8bb59813-9416-43bc-8d12-a122bdfa415e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.105209] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8bb59813-9416-43bc-8d12-a122bdfa415e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.106362] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5704e4e3-8211-4e30-b474-06c668cf060d taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.106588] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.106995] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-626f4e51-c3dc-4318-acdd-bb61945d5f1f taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.107214] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-626f4e51-c3dc-4318-acdd-bb61945d5f1f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.525064] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 in Status: SUCCESS [ 684.525343] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.525511] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.525727] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.526934] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.526934] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.526934] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.526934] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.526934] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.526934] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a595937-aa58-40f8-a3cf-b57a814011e8',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.528848] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5704e4e3-8211-4e30-b474-06c668cf060d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.529632] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('626f4e51-c3dc-4318-acdd-bb61945d5f1f',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.608194] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5704e4e3-8211-4e30-b474-06c668cf060d taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.608411] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.609027] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-626f4e51-c3dc-4318-acdd-bb61945d5f1f taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.609027] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-626f4e51-c3dc-4318-acdd-bb61945d5f1f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.609491] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8bb59813-9416-43bc-8d12-a122bdfa415e with status ACTIVE [ 684.609740] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.609916] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.610049] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.610327] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.610422] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.610598] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.610697] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.610749] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.610899] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.610978] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.611225] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.611329] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.612521] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.612696] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.612790] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.612868] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8bb59813-9416-43bc-8d12-a122bdfa415e is going to be updated. [ 684.636318] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.636538] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.636538] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.636871] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.637018] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.637191] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8bb59813-9416-43bc-8d12-a122bdfa415e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.029404] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3a595937-aa58-40f8-a3cf-b57a814011e8',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.036226] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5704e4e3-8211-4e30-b474-06c668cf060d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.037520] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('626f4e51-c3dc-4318-acdd-bb61945d5f1f',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.442807] env[62842]: INFO networking_nsxv3.common.synchronization [req-2bc63aed-6e89-4164-9e32-08b68398c7fe req-f4325d14-7925-4cf5-a665-850cdce5e6b1 tempest-ListServersNegativeTestJSON-2108045219 tempest-ListServersNegativeTestJSON-2108045219-project-member] Enqueued Resource ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 with Priority: HIGHEST for action security_group_members [ 685.443593] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 with Priority: HIGHEST for action security_group_members [ 685.443852] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a595937-aa58-40f8-a3cf-b57a814011e8 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.444660] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.532115] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3a595937-aa58-40f8-a3cf-b57a814011e8',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.539703] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.539703] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.539703] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.540675] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.540675] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.540675] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5704e4e3-8211-4e30-b474-06c668cf060d is going to be updated. [ 685.544610] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.544759] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.545586] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.545586] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.545586] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.545844] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 626f4e51-c3dc-4318-acdd-bb61945d5f1f is going to be created. [ 685.575077] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.575077] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.575077] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.575077] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.575077] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.575077] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.575077] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.576435] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.576804] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.577092] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.593262] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5704e4e3-8211-4e30-b474-06c668cf060d in Status: IN_PROGRESS for 2s [ 685.593262] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 626f4e51-c3dc-4318-acdd-bb61945d5f1f in Status: UNINITIALIZED for 2s [ 686.034788] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.034952] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.034952] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.035242] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.035740] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.035740] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 is going to be updated. [ 686.072022] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.072022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.072022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.072022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.072022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.083501] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 in Status: IN_PROGRESS for 2s [ 686.430306] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-81 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.432520] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-81" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.432666] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-81" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.432949] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-81" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.433396] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.433612] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.434115] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.434441] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.434902] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.434902] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 686.435961] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 686.435961] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 686.435961] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 686.435961] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 686.435961] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 686.435961] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 686.459893] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 686.459893] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 686.464040] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 686.464040] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-81" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.464040] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-05cd2bcb-aa21-4e81-90e4-f90f1b081b8d taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.464040] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-05cd2bcb-aa21-4e81-90e4-f90f1b081b8d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.464040] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-05cd2bcb-aa21-4e81-90e4-f90f1b081b8d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.464040] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-05cd2bcb-aa21-4e81-90e4-f90f1b081b8d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.464040] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05cd2bcb-aa21-4e81-90e4-f90f1b081b8d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.468023] env[62842]: INFO networking_nsxv3.common.synchronization [None req-7b65c9bc-889e-4bda-b9ac-ff6e4054d0c5 None None] Enqueued Resource ID: ddcac5ca-abef-410a-bc25-79c340c24213 with Priority: HIGHEST for action port [ 686.468023] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddcac5ca-abef-410a-bc25-79c340c24213 with Priority: HIGHEST for action port [ 686.468023] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-ddcac5ca-abef-410a-bc25-79c340c24213 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.468023] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ddcac5ca-abef-410a-bc25-79c340c24213" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.468023] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ddcac5ca-abef-410a-bc25-79c340c24213" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.468023] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ddcac5ca-abef-410a-bc25-79c340c24213" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.468023] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ddcac5ca-abef-410a-bc25-79c340c24213',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.965867] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.966291] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.966291] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.966404] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.966552] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.966706] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 05cd2bcb-aa21-4e81-90e4-f90f1b081b8d not found, creating... [ 686.967133] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.967133] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.967290] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.967450] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.967584] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.967861] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.968035] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.968147] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.969562] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.969816] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.969983] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 05cd2bcb-aa21-4e81-90e4-f90f1b081b8d is going to be created. [ 686.971128] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ddcac5ca-abef-410a-bc25-79c340c24213 [ 686.971297] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.971401] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.971464] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.971612] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.971844] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.971844] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ddcac5ca-abef-410a-bc25-79c340c24213 already deleted. [ 686.971927] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ddcac5ca-abef-410a-bc25-79c340c24213" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.997034] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.997227] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.997365] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.997636] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.997863] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.998108] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-05cd2bcb-aa21-4e81-90e4-f90f1b081b8d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.606469] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 626f4e51-c3dc-4318-acdd-bb61945d5f1f in Status: SUCCESS [ 687.606469] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-626f4e51-c3dc-4318-acdd-bb61945d5f1f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.606469] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-626f4e51-c3dc-4318-acdd-bb61945d5f1f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.606469] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-626f4e51-c3dc-4318-acdd-bb61945d5f1f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.606469] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.606469] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.606469] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.606469] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.606469] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.606469] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('626f4e51-c3dc-4318-acdd-bb61945d5f1f',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.611043] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5704e4e3-8211-4e30-b474-06c668cf060d in Status: SUCCESS [ 687.611351] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.611555] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.611896] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.612023] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.612079] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.612141] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.612291] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.612410] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.612469] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5704e4e3-8211-4e30-b474-06c668cf060d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.962746] env[62842]: INFO networking_nsxv3.common.synchronization [req-2bc63aed-6e89-4164-9e32-08b68398c7fe req-7dec9436-62f5-4c10-a281-bce581ed56ab service nova] Enqueued Resource ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 with Priority: HIGHEST for action security_group_rules [ 687.962997] env[62842]: INFO networking_nsxv3.common.synchronization [req-2bc63aed-6e89-4164-9e32-08b68398c7fe req-7dec9436-62f5-4c10-a281-bce581ed56ab service nova] Enqueued Resource ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 with Priority: HIGHEST for action security_group_members [ 687.963219] env[62842]: INFO networking_nsxv3.common.synchronization [req-2bc63aed-6e89-4164-9e32-08b68398c7fe req-7dec9436-62f5-4c10-a281-bce581ed56ab service nova] Enqueued Resource ID: 05cd2bcb-aa21-4e81-90e4-f90f1b081b8d with Priority: HIGHEST for action port [ 687.963875] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 with Priority: HIGHEST for action security_group_rules [ 687.964243] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 with Priority: HIGHEST for action security_group_members [ 687.964430] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05cd2bcb-aa21-4e81-90e4-f90f1b081b8d with Priority: HIGHEST for action port [ 687.964823] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a595937-aa58-40f8-a3cf-b57a814011e8 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.964903] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.965152] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a595937-aa58-40f8-a3cf-b57a814011e8 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.965267] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.965500] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-05cd2bcb-aa21-4e81-90e4-f90f1b081b8d taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.965625] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-05cd2bcb-aa21-4e81-90e4-f90f1b081b8d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.965704] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-05cd2bcb-aa21-4e81-90e4-f90f1b081b8d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.965965] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-05cd2bcb-aa21-4e81-90e4-f90f1b081b8d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.966299] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05cd2bcb-aa21-4e81-90e4-f90f1b081b8d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.052188] env[62842]: INFO networking_nsxv3.common.synchronization [req-09605919-9989-414f-8c2f-61f2007279d3 req-494ebd02-dc86-4a74-a2a7-cca3463334a5 tempest-AttachInterfacesV270Test-844636407 tempest-AttachInterfacesV270Test-844636407-project-member] Enqueued Resource ID: b321faa1-947f-4c79-ac72-202730c0dcd1 with Priority: HIGHEST for action security_group_members [ 688.052676] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b321faa1-947f-4c79-ac72-202730c0dcd1 with Priority: HIGHEST for action security_group_members [ 688.052967] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-b321faa1-947f-4c79-ac72-202730c0dcd1 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.053090] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b321faa1-947f-4c79-ac72-202730c0dcd1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.053153] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b321faa1-947f-4c79-ac72-202730c0dcd1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.053402] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b321faa1-947f-4c79-ac72-202730c0dcd1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.053555] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.053649] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.053707] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.053862] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.053942] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.054043] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b321faa1-947f-4c79-ac72-202730c0dcd1',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.093970] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 in Status: SUCCESS [ 688.094221] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.094384] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.094602] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.094896] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.094896] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.095039] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.095115] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.095196] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.095281] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.095375] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3a595937-aa58-40f8-a3cf-b57a814011e8',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.096260] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.096431] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.096619] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.096706] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.096759] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.096876] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.096969] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.097109] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a595937-aa58-40f8-a3cf-b57a814011e8',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.109521] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('626f4e51-c3dc-4318-acdd-bb61945d5f1f',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.114462] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5704e4e3-8211-4e30-b474-06c668cf060d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.469036] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 05cd2bcb-aa21-4e81-90e4-f90f1b081b8d with status ACTIVE [ 688.469277] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.469802] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.469802] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.469802] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.469802] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.469968] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.470215] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.470215] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.470719] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.470719] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.470719] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.470719] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.470869] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.470922] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.471091] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.471501] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 05cd2bcb-aa21-4e81-90e4-f90f1b081b8d is going to be updated. [ 688.495028] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.495028] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.495028] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.495028] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.495028] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.495028] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-05cd2bcb-aa21-4e81-90e4-f90f1b081b8d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.557586] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.557855] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.557855] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.558015] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.558199] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.558422] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.558528] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.558586] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.558809] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.558909] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.559069] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b321faa1-947f-4c79-ac72-202730c0dcd1 already deleted. [ 688.559118] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b321faa1-947f-4c79-ac72-202730c0dcd1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.595287] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-756 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.595287] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-756" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.595287] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-756" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.595287] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-756" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.595558] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.595558] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.595691] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.596167] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.596487] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.597058] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 688.597058] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 688.597171] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 688.597247] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 688.597409] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 688.597474] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 688.597601] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 688.599094] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3a595937-aa58-40f8-a3cf-b57a814011e8',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.600487] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a595937-aa58-40f8-a3cf-b57a814011e8 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.600650] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.613515] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('626f4e51-c3dc-4318-acdd-bb61945d5f1f',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.616855] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5704e4e3-8211-4e30-b474-06c668cf060d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.654528] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 688.654795] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.057 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 688.654959] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 688.655191] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-756" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.655519] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-e9e5294a-6c2b-4a60-a01c-56c72193769b taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.655695] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-e9e5294a-6c2b-4a60-a01c-56c72193769b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.655814] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-e9e5294a-6c2b-4a60-a01c-56c72193769b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.656283] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-e9e5294a-6c2b-4a60-a01c-56c72193769b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.656428] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9e5294a-6c2b-4a60-a01c-56c72193769b',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.102141] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3a595937-aa58-40f8-a3cf-b57a814011e8',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.116435] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.116682] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.116682] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.116891] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.116998] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.117133] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 626f4e51-c3dc-4318-acdd-bb61945d5f1f is going to be updated. [ 689.118550] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.118704] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.118887] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.118974] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.119075] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.119173] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5704e4e3-8211-4e30-b474-06c668cf060d is going to be updated. [ 689.159353] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.159726] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.159726] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.159985] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.160196] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.160445] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port e9e5294a-6c2b-4a60-a01c-56c72193769b not found, creating... [ 689.160921] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.161486] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.161486] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.161678] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.161928] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.162571] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.162781] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.162965] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.163335] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.163575] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.163817] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: e9e5294a-6c2b-4a60-a01c-56c72193769b is going to be created. [ 689.167446] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.167572] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.167572] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.167732] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.167882] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.169697] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.169857] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.169939] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.170159] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.170295] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.185393] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 626f4e51-c3dc-4318-acdd-bb61945d5f1f in Status: IN_PROGRESS for 2s [ 689.186569] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5704e4e3-8211-4e30-b474-06c668cf060d in Status: IN_PROGRESS for 2s [ 689.209815] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.210106] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.210222] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.210506] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.210739] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.211023] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-e9e5294a-6c2b-4a60-a01c-56c72193769b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.604742] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.605038] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.605162] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.605488] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.605650] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.605828] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 is going to be updated. [ 689.641434] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.641434] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.641434] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.641434] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.641434] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.654367] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 in Status: IN_PROGRESS for 2s [ 689.999378] env[62842]: INFO networking_nsxv3.common.synchronization [req-09605919-9989-414f-8c2f-61f2007279d3 req-ed208500-32a8-4e3e-8b4d-a97ec3ffa9a5 service nova] Enqueued Resource ID: b321faa1-947f-4c79-ac72-202730c0dcd1 with Priority: HIGHEST for action security_group_rules [ 689.999574] env[62842]: INFO networking_nsxv3.common.synchronization [req-09605919-9989-414f-8c2f-61f2007279d3 req-ed208500-32a8-4e3e-8b4d-a97ec3ffa9a5 service nova] Enqueued Resource ID: b321faa1-947f-4c79-ac72-202730c0dcd1 with Priority: HIGHEST for action security_group_members [ 689.999686] env[62842]: INFO networking_nsxv3.common.synchronization [req-09605919-9989-414f-8c2f-61f2007279d3 req-ed208500-32a8-4e3e-8b4d-a97ec3ffa9a5 service nova] Enqueued Resource ID: e9e5294a-6c2b-4a60-a01c-56c72193769b with Priority: HIGHEST for action port [ 690.000239] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b321faa1-947f-4c79-ac72-202730c0dcd1 with Priority: HIGHEST for action security_group_rules [ 690.000408] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b321faa1-947f-4c79-ac72-202730c0dcd1 with Priority: HIGHEST for action security_group_members [ 690.000512] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9e5294a-6c2b-4a60-a01c-56c72193769b with Priority: HIGHEST for action port [ 690.000813] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b321faa1-947f-4c79-ac72-202730c0dcd1 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.000937] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b321faa1-947f-4c79-ac72-202730c0dcd1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.001013] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b321faa1-947f-4c79-ac72-202730c0dcd1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.004230] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b321faa1-947f-4c79-ac72-202730c0dcd1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.004324] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b321faa1-947f-4c79-ac72-202730c0dcd1',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.005176] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-b321faa1-947f-4c79-ac72-202730c0dcd1 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.005292] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b321faa1-947f-4c79-ac72-202730c0dcd1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.005359] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b321faa1-947f-4c79-ac72-202730c0dcd1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.005527] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b321faa1-947f-4c79-ac72-202730c0dcd1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.005676] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.005772] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.005836] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.005977] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.006078] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.006167] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b321faa1-947f-4c79-ac72-202730c0dcd1',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.006933] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-e9e5294a-6c2b-4a60-a01c-56c72193769b taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.009869] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e9e5294a-6c2b-4a60-a01c-56c72193769b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.009973] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e9e5294a-6c2b-4a60-a01c-56c72193769b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.010176] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e9e5294a-6c2b-4a60-a01c-56c72193769b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.010272] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9e5294a-6c2b-4a60-a01c-56c72193769b',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.515022] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b321faa1-947f-4c79-ac72-202730c0dcd1',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.515022] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-b321faa1-947f-4c79-ac72-202730c0dcd1 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.515022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b321faa1-947f-4c79-ac72-202730c0dcd1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.515022] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e9e5294a-6c2b-4a60-a01c-56c72193769b with status ACTIVE [ 690.515022] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.515022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.515022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.515022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.515022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.515022] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.515022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.515740] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.515740] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.515740] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.516363] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.516363] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.516363] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.516363] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.516363] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.516568] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e9e5294a-6c2b-4a60-a01c-56c72193769b is going to be updated. [ 690.540974] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.541146] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.541201] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.541404] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.541643] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.541723] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e9e5294a-6c2b-4a60-a01c-56c72193769b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.843823] env[62842]: INFO networking_nsxv3.common.synchronization [req-8c1e3bcb-4156-4f48-ae08-24a478ba4224 req-1a5ee6d2-6756-4339-8920-a2870e602d96 tempest-SecurityGroupsTestJSON-1354345429 tempest-SecurityGroupsTestJSON-1354345429-project-member] Enqueued Resource ID: 5704e4e3-8211-4e30-b474-06c668cf060d with Priority: HIGHEST for action security_group_members [ 690.843974] env[62842]: INFO networking_nsxv3.common.synchronization [req-8c1e3bcb-4156-4f48-ae08-24a478ba4224 req-1a5ee6d2-6756-4339-8920-a2870e602d96 tempest-SecurityGroupsTestJSON-1354345429 tempest-SecurityGroupsTestJSON-1354345429-project-member] Enqueued Resource ID: 626f4e51-c3dc-4318-acdd-bb61945d5f1f with Priority: HIGHEST for action security_group_members [ 690.844149] env[62842]: INFO networking_nsxv3.common.synchronization [req-8c1e3bcb-4156-4f48-ae08-24a478ba4224 req-1a5ee6d2-6756-4339-8920-a2870e602d96 tempest-SecurityGroupsTestJSON-1354345429 tempest-SecurityGroupsTestJSON-1354345429-project-member] Enqueued Resource ID: 8fac3119-fae2-425a-a2df-e0fbbaa49c36 with Priority: HIGHEST for action security_group_members [ 690.844679] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5704e4e3-8211-4e30-b474-06c668cf060d with Priority: HIGHEST for action security_group_members [ 690.845372] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 626f4e51-c3dc-4318-acdd-bb61945d5f1f with Priority: HIGHEST for action security_group_members [ 690.845372] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fac3119-fae2-425a-a2df-e0fbbaa49c36 with Priority: HIGHEST for action security_group_members [ 690.845739] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5704e4e3-8211-4e30-b474-06c668cf060d taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.846567] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.846567] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-626f4e51-c3dc-4318-acdd-bb61945d5f1f taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.846567] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-626f4e51-c3dc-4318-acdd-bb61945d5f1f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.846567] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-8fac3119-fae2-425a-a2df-e0fbbaa49c36 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.847540] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8fac3119-fae2-425a-a2df-e0fbbaa49c36" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.847540] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8fac3119-fae2-425a-a2df-e0fbbaa49c36" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.847540] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8fac3119-fae2-425a-a2df-e0fbbaa49c36" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.847540] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.847540] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.847798] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.847898] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.848090] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.848348] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8fac3119-fae2-425a-a2df-e0fbbaa49c36',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.890173] env[62842]: INFO networking_nsxv3.common.synchronization [req-8c1e3bcb-4156-4f48-ae08-24a478ba4224 req-1a5ee6d2-6756-4339-8920-a2870e602d96 tempest-SecurityGroupsTestJSON-1354345429 tempest-SecurityGroupsTestJSON-1354345429-project-member] Enqueued Resource ID: 5704e4e3-8211-4e30-b474-06c668cf060d with Priority: HIGHEST for action security_group_rules [ 690.890444] env[62842]: INFO networking_nsxv3.common.synchronization [req-8c1e3bcb-4156-4f48-ae08-24a478ba4224 req-1a5ee6d2-6756-4339-8920-a2870e602d96 tempest-SecurityGroupsTestJSON-1354345429 tempest-SecurityGroupsTestJSON-1354345429-project-member] Enqueued Resource ID: 5704e4e3-8211-4e30-b474-06c668cf060d with Priority: HIGHEST for action security_group_members [ 690.890654] env[62842]: INFO networking_nsxv3.common.synchronization [req-8c1e3bcb-4156-4f48-ae08-24a478ba4224 req-1a5ee6d2-6756-4339-8920-a2870e602d96 tempest-SecurityGroupsTestJSON-1354345429 tempest-SecurityGroupsTestJSON-1354345429-project-member] Enqueued Resource ID: 626f4e51-c3dc-4318-acdd-bb61945d5f1f with Priority: HIGHEST for action security_group_rules [ 690.890846] env[62842]: INFO networking_nsxv3.common.synchronization [req-8c1e3bcb-4156-4f48-ae08-24a478ba4224 req-1a5ee6d2-6756-4339-8920-a2870e602d96 tempest-SecurityGroupsTestJSON-1354345429 tempest-SecurityGroupsTestJSON-1354345429-project-member] Enqueued Resource ID: 626f4e51-c3dc-4318-acdd-bb61945d5f1f with Priority: HIGHEST for action security_group_members [ 690.891268] env[62842]: INFO networking_nsxv3.common.synchronization [req-8c1e3bcb-4156-4f48-ae08-24a478ba4224 req-1a5ee6d2-6756-4339-8920-a2870e602d96 tempest-SecurityGroupsTestJSON-1354345429 tempest-SecurityGroupsTestJSON-1354345429-project-member] Enqueued Resource ID: 8fac3119-fae2-425a-a2df-e0fbbaa49c36 with Priority: HIGHEST for action security_group_rules [ 690.891589] env[62842]: INFO networking_nsxv3.common.synchronization [req-8c1e3bcb-4156-4f48-ae08-24a478ba4224 req-1a5ee6d2-6756-4339-8920-a2870e602d96 tempest-SecurityGroupsTestJSON-1354345429 tempest-SecurityGroupsTestJSON-1354345429-project-member] Enqueued Resource ID: 8fac3119-fae2-425a-a2df-e0fbbaa49c36 with Priority: HIGHEST for action security_group_members [ 690.891700] env[62842]: INFO networking_nsxv3.common.synchronization [req-8c1e3bcb-4156-4f48-ae08-24a478ba4224 req-1a5ee6d2-6756-4339-8920-a2870e602d96 tempest-SecurityGroupsTestJSON-1354345429 tempest-SecurityGroupsTestJSON-1354345429-project-member] Enqueued Resource ID: 8bb59813-9416-43bc-8d12-a122bdfa415e with Priority: HIGHEST for action port [ 690.892635] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5704e4e3-8211-4e30-b474-06c668cf060d with Priority: HIGHEST for action security_group_rules [ 690.892827] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 626f4e51-c3dc-4318-acdd-bb61945d5f1f with Priority: HIGHEST for action security_group_rules [ 690.892968] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fac3119-fae2-425a-a2df-e0fbbaa49c36 with Priority: HIGHEST for action security_group_members [ 690.893125] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bb59813-9416-43bc-8d12-a122bdfa415e with Priority: HIGHEST for action port [ 690.893262] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fac3119-fae2-425a-a2df-e0fbbaa49c36 with Priority: HIGHEST for action security_group_rules [ 690.893591] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5704e4e3-8211-4e30-b474-06c668cf060d with Priority: HIGHEST for action security_group_members [ 690.893766] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 626f4e51-c3dc-4318-acdd-bb61945d5f1f with Priority: HIGHEST for action security_group_members [ 690.894484] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5704e4e3-8211-4e30-b474-06c668cf060d taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.894633] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.894999] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-626f4e51-c3dc-4318-acdd-bb61945d5f1f taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.895073] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-626f4e51-c3dc-4318-acdd-bb61945d5f1f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.895274] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-8fac3119-fae2-425a-a2df-e0fbbaa49c36 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.895398] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8fac3119-fae2-425a-a2df-e0fbbaa49c36" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.895625] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-8bb59813-9416-43bc-8d12-a122bdfa415e taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.895762] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8bb59813-9416-43bc-8d12-a122bdfa415e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.895856] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8bb59813-9416-43bc-8d12-a122bdfa415e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.897310] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8bb59813-9416-43bc-8d12-a122bdfa415e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.897412] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8bb59813-9416-43bc-8d12-a122bdfa415e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.898256] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8fac3119-fae2-425a-a2df-e0fbbaa49c36 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.898369] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8fac3119-fae2-425a-a2df-e0fbbaa49c36" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.898436] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8fac3119-fae2-425a-a2df-e0fbbaa49c36" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.898666] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8fac3119-fae2-425a-a2df-e0fbbaa49c36" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.898790] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8fac3119-fae2-425a-a2df-e0fbbaa49c36',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.899563] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5704e4e3-8211-4e30-b474-06c668cf060d taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.901040] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.901040] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-626f4e51-c3dc-4318-acdd-bb61945d5f1f taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.901040] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-626f4e51-c3dc-4318-acdd-bb61945d5f1f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.019173] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b321faa1-947f-4c79-ac72-202730c0dcd1',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.200162] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 626f4e51-c3dc-4318-acdd-bb61945d5f1f in Status: SUCCESS [ 691.200434] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-626f4e51-c3dc-4318-acdd-bb61945d5f1f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.201171] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5704e4e3-8211-4e30-b474-06c668cf060d in Status: SUCCESS [ 691.201365] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.201516] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-626f4e51-c3dc-4318-acdd-bb61945d5f1f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.201733] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-626f4e51-c3dc-4318-acdd-bb61945d5f1f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.201982] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.202095] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.202153] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.202310] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.202376] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.202659] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-626f4e51-c3dc-4318-acdd-bb61945d5f1f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.202659] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('626f4e51-c3dc-4318-acdd-bb61945d5f1f',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.203828] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.204018] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.204153] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.204255] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.204320] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.204466] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.204466] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.204626] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.204798] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5704e4e3-8211-4e30-b474-06c668cf060d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.205733] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-626f4e51-c3dc-4318-acdd-bb61945d5f1f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.205733] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-626f4e51-c3dc-4318-acdd-bb61945d5f1f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.205890] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.205997] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.206274] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.206274] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.206274] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.206508] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('626f4e51-c3dc-4318-acdd-bb61945d5f1f',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.207055] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.207264] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.207366] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.207463] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.207524] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.207655] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.207735] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.207819] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5704e4e3-8211-4e30-b474-06c668cf060d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.351162] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8fac3119-fae2-425a-a2df-e0fbbaa49c36',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.404012] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8bb59813-9416-43bc-8d12-a122bdfa415e with status ACTIVE [ 691.404012] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.404012] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.404012] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.404012] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.404012] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.404012] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.404012] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.404012] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.404012] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.404012] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.404012] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.404012] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.404012] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.404012] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.404012] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.404012] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8bb59813-9416-43bc-8d12-a122bdfa415e is going to be updated. [ 691.405411] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-8fac3119-fae2-425a-a2df-e0fbbaa49c36 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.405411] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8fac3119-fae2-425a-a2df-e0fbbaa49c36" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.433993] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.434167] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.434244] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.434490] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.434757] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.434836] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8bb59813-9416-43bc-8d12-a122bdfa415e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.522558] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.522932] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.522932] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.523069] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.523190] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.523257] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b321faa1-947f-4c79-ac72-202730c0dcd1 is going to be created. [ 691.558182] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.558356] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.558419] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.558640] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.558900] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.578418] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b321faa1-947f-4c79-ac72-202730c0dcd1 in Status: UNINITIALIZED for 2s [ 691.668511] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 in Status: SUCCESS [ 691.668775] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.669056] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.669250] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.669463] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.669577] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.669633] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.669849] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.669913] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.669962] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a595937-aa58-40f8-a3cf-b57a814011e8',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.712427] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('626f4e51-c3dc-4318-acdd-bb61945d5f1f',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.712427] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5704e4e3-8211-4e30-b474-06c668cf060d taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.712427] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.712427] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('626f4e51-c3dc-4318-acdd-bb61945d5f1f',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.715283] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5704e4e3-8211-4e30-b474-06c668cf060d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.853468] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8fac3119-fae2-425a-a2df-e0fbbaa49c36',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.173043] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3a595937-aa58-40f8-a3cf-b57a814011e8',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.214480] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('626f4e51-c3dc-4318-acdd-bb61945d5f1f',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.215898] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 626f4e51-c3dc-4318-acdd-bb61945d5f1f: rpc.has_security_group_logging(os_id): False [ 692.217850] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5704e4e3-8211-4e30-b474-06c668cf060d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.243673] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.244071] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.244217] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.244472] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.245068] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.245384] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.245524] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.245619] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.245822] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.245943] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.246077] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 626f4e51-c3dc-4318-acdd-bb61945d5f1f is going to be created. [ 692.307531] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.307732] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.307732] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.307957] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.308161] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.322165] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 626f4e51-c3dc-4318-acdd-bb61945d5f1f in Status: IN_PROGRESS for 2s [ 692.356986] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.357076] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.357109] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.357322] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.357415] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.357532] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8fac3119-fae2-425a-a2df-e0fbbaa49c36 is going to be created. [ 692.406545] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.406703] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.406840] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.407058] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.407221] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.422264] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8fac3119-fae2-425a-a2df-e0fbbaa49c36 in Status: UNINITIALIZED for 2s [ 692.423254] env[62842]: INFO networking_nsxv3.common.synchronization [req-7464fbdf-4591-4936-9cc7-45346df204c9 req-38206a48-0f1e-41b3-87c8-ab26b12ff95a tempest-ServersTestJSON-1961539448 tempest-ServersTestJSON-1961539448-project-member] Enqueued Resource ID: 2d753783-8988-4639-a0fc-596bf03e413b with Priority: HIGHEST for action security_group_members [ 692.423783] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d753783-8988-4639-a0fc-596bf03e413b with Priority: HIGHEST for action security_group_members [ 692.424612] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d753783-8988-4639-a0fc-596bf03e413b taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.424782] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d753783-8988-4639-a0fc-596bf03e413b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.424874] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d753783-8988-4639-a0fc-596bf03e413b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.425166] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d753783-8988-4639-a0fc-596bf03e413b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.425367] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.425515] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.425601] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.425793] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.425935] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.426074] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d753783-8988-4639-a0fc-596bf03e413b',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.676387] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3a595937-aa58-40f8-a3cf-b57a814011e8',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.719270] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.719494] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.719606] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.719926] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.720084] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.720239] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 626f4e51-c3dc-4318-acdd-bb61945d5f1f is going to be updated. [ 692.721818] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.721941] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.721986] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.723330] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.723584] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.723640] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5704e4e3-8211-4e30-b474-06c668cf060d is going to be updated. [ 692.765517] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.765701] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.765799] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.766119] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.767855] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.769765] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.769961] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.770332] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.770703] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.770814] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.801438] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 626f4e51-c3dc-4318-acdd-bb61945d5f1f in Status: IN_PROGRESS for 2s [ 692.807419] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5704e4e3-8211-4e30-b474-06c668cf060d in Status: IN_PROGRESS for 2s [ 692.929547] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.929547] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.929547] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.929547] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.929547] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.929547] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.929547] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.929547] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.929547] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.929547] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.929547] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d753783-8988-4639-a0fc-596bf03e413b already deleted. [ 692.929547] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d753783-8988-4639-a0fc-596bf03e413b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.179983] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.179983] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.179983] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.179983] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.180278] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.180278] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 is going to be updated. [ 693.214257] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.214405] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.214451] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.214712] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.214835] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.228927] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 in Status: IN_PROGRESS for 2s [ 693.276137] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-917 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.276137] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-917" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.276137] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-917" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.276137] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-917" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.276137] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.276137] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.276137] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.277913] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.278232] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.278598] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 693.278848] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 693.279107] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 693.279308] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 693.279539] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 693.279733] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 693.279968] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 693.302524] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 693.302524] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 693.302524] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 693.302524] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-917" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.302945] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-9b6132da-2bf9-438f-ac9d-d02c8a902947 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.302945] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-9b6132da-2bf9-438f-ac9d-d02c8a902947" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.303178] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-9b6132da-2bf9-438f-ac9d-d02c8a902947" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.303400] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-9b6132da-2bf9-438f-ac9d-d02c8a902947" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.303530] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b6132da-2bf9-438f-ac9d-d02c8a902947',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.595395] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b321faa1-947f-4c79-ac72-202730c0dcd1 in Status: SUCCESS [ 693.595907] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b321faa1-947f-4c79-ac72-202730c0dcd1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.596168] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b321faa1-947f-4c79-ac72-202730c0dcd1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.596465] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b321faa1-947f-4c79-ac72-202730c0dcd1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.596726] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.596883] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.596974] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.597200] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.597318] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.597437] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b321faa1-947f-4c79-ac72-202730c0dcd1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.597562] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b321faa1-947f-4c79-ac72-202730c0dcd1',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.809013] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.809397] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.809651] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.810082] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.810364] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.810625] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 9b6132da-2bf9-438f-ac9d-d02c8a902947 not found, creating... [ 693.811101] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.811375] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.811574] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.811946] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.812197] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.812669] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.812921] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.813138] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.813482] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.813797] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.814054] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 9b6132da-2bf9-438f-ac9d-d02c8a902947 is going to be created. [ 693.846698] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.847368] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.847368] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.847490] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.847623] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.847849] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-9b6132da-2bf9-438f-ac9d-d02c8a902947" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.955309] env[62842]: INFO networking_nsxv3.common.synchronization [req-00ec9919-f6d2-4434-acad-f1540c4cf8d2 req-795837c7-ccf1-4762-8183-d18634155403 tempest-SecurityGroupsTestJSON-1354345429 tempest-SecurityGroupsTestJSON-1354345429-project-member] Enqueued Resource ID: 8fac3119-fae2-425a-a2df-e0fbbaa49c36 with Priority: HIGHEST for action security_group_members [ 693.955606] env[62842]: INFO networking_nsxv3.common.synchronization [req-00ec9919-f6d2-4434-acad-f1540c4cf8d2 req-795837c7-ccf1-4762-8183-d18634155403 tempest-SecurityGroupsTestJSON-1354345429 tempest-SecurityGroupsTestJSON-1354345429-project-member] Enqueued Resource ID: 5704e4e3-8211-4e30-b474-06c668cf060d with Priority: HIGHEST for action security_group_members [ 693.955783] env[62842]: INFO networking_nsxv3.common.synchronization [req-00ec9919-f6d2-4434-acad-f1540c4cf8d2 req-795837c7-ccf1-4762-8183-d18634155403 tempest-SecurityGroupsTestJSON-1354345429 tempest-SecurityGroupsTestJSON-1354345429-project-member] Enqueued Resource ID: 626f4e51-c3dc-4318-acdd-bb61945d5f1f with Priority: HIGHEST for action security_group_members [ 693.957091] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fac3119-fae2-425a-a2df-e0fbbaa49c36 with Priority: HIGHEST for action security_group_members [ 693.957091] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5704e4e3-8211-4e30-b474-06c668cf060d with Priority: HIGHEST for action security_group_members [ 693.957091] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 626f4e51-c3dc-4318-acdd-bb61945d5f1f with Priority: HIGHEST for action security_group_members [ 693.957242] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-8fac3119-fae2-425a-a2df-e0fbbaa49c36 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.957242] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8fac3119-fae2-425a-a2df-e0fbbaa49c36" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.957431] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5704e4e3-8211-4e30-b474-06c668cf060d taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.957562] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.957797] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-626f4e51-c3dc-4318-acdd-bb61945d5f1f taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.957890] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-626f4e51-c3dc-4318-acdd-bb61945d5f1f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.099844] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-b321faa1-947f-4c79-ac72-202730c0dcd1 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.100060] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b321faa1-947f-4c79-ac72-202730c0dcd1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.100136] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b321faa1-947f-4c79-ac72-202730c0dcd1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.100909] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b321faa1-947f-4c79-ac72-202730c0dcd1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.100978] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.101057] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.101099] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.101264] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.101356] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.101446] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b321faa1-947f-4c79-ac72-202730c0dcd1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.101631] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-b321faa1-947f-4c79-ac72-202730c0dcd1 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.101678] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b321faa1-947f-4c79-ac72-202730c0dcd1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.101738] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b321faa1-947f-4c79-ac72-202730c0dcd1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.101895] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b321faa1-947f-4c79-ac72-202730c0dcd1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.102058] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.102154] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.102214] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.102352] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.102429] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.102508] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b321faa1-947f-4c79-ac72-202730c0dcd1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.102598] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b321faa1-947f-4c79-ac72-202730c0dcd1',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.337944] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 626f4e51-c3dc-4318-acdd-bb61945d5f1f in Status: SUCCESS [ 694.338202] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-626f4e51-c3dc-4318-acdd-bb61945d5f1f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.338371] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-626f4e51-c3dc-4318-acdd-bb61945d5f1f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.338624] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-626f4e51-c3dc-4318-acdd-bb61945d5f1f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.338707] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('626f4e51-c3dc-4318-acdd-bb61945d5f1f',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.434427] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8fac3119-fae2-425a-a2df-e0fbbaa49c36 in Status: SUCCESS [ 694.434687] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8fac3119-fae2-425a-a2df-e0fbbaa49c36" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.434995] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8fac3119-fae2-425a-a2df-e0fbbaa49c36" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.435132] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8fac3119-fae2-425a-a2df-e0fbbaa49c36" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.435372] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.435533] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.435618] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.435778] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.435860] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.435955] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8fac3119-fae2-425a-a2df-e0fbbaa49c36',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.591383] env[62842]: INFO networking_nsxv3.common.synchronization [req-7464fbdf-4591-4936-9cc7-45346df204c9 req-d3388dd1-47d0-48d2-b40e-280065bb7726 service nova] Enqueued Resource ID: 2d753783-8988-4639-a0fc-596bf03e413b with Priority: HIGHEST for action security_group_rules [ 694.592325] env[62842]: INFO networking_nsxv3.common.synchronization [req-7464fbdf-4591-4936-9cc7-45346df204c9 req-d3388dd1-47d0-48d2-b40e-280065bb7726 service nova] Enqueued Resource ID: 2d753783-8988-4639-a0fc-596bf03e413b with Priority: HIGHEST for action security_group_members [ 694.592696] env[62842]: INFO networking_nsxv3.common.synchronization [req-7464fbdf-4591-4936-9cc7-45346df204c9 req-d3388dd1-47d0-48d2-b40e-280065bb7726 service nova] Enqueued Resource ID: 9b6132da-2bf9-438f-ac9d-d02c8a902947 with Priority: HIGHEST for action port [ 694.593046] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d753783-8988-4639-a0fc-596bf03e413b with Priority: HIGHEST for action security_group_rules [ 694.593248] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d753783-8988-4639-a0fc-596bf03e413b with Priority: HIGHEST for action security_group_members [ 694.593505] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b6132da-2bf9-438f-ac9d-d02c8a902947 with Priority: HIGHEST for action port [ 694.597099] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d753783-8988-4639-a0fc-596bf03e413b taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.597293] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d753783-8988-4639-a0fc-596bf03e413b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.597420] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d753783-8988-4639-a0fc-596bf03e413b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.597766] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d753783-8988-4639-a0fc-596bf03e413b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.597906] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d753783-8988-4639-a0fc-596bf03e413b',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.600613] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d753783-8988-4639-a0fc-596bf03e413b taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.600731] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d753783-8988-4639-a0fc-596bf03e413b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.601607] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d753783-8988-4639-a0fc-596bf03e413b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.601852] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d753783-8988-4639-a0fc-596bf03e413b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.602032] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.602142] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.602206] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.602359] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.602447] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.602540] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d753783-8988-4639-a0fc-596bf03e413b',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.603564] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b6132da-2bf9-438f-ac9d-d02c8a902947 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.603690] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b6132da-2bf9-438f-ac9d-d02c8a902947" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.603758] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b6132da-2bf9-438f-ac9d-d02c8a902947" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.604017] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b6132da-2bf9-438f-ac9d-d02c8a902947" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.604017] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b6132da-2bf9-438f-ac9d-d02c8a902947',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.605297] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b321faa1-947f-4c79-ac72-202730c0dcd1: rpc.has_security_group_logging(os_id): False [ 694.625130] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.625315] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.625387] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.625825] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.625825] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.626021] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.626116] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.626187] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.626339] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.626418] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.630024] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.630024] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.630024] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.630024] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.630024] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.630024] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.630024] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.630024] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.630024] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.630024] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.630024] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b321faa1-947f-4c79-ac72-202730c0dcd1 is going to be created. [ 694.698025] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.698025] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.698025] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.698025] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.698025] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.707397] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b321faa1-947f-4c79-ac72-202730c0dcd1 in Status: IN_PROGRESS for 2s [ 694.811963] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 626f4e51-c3dc-4318-acdd-bb61945d5f1f in Status: SUCCESS [ 694.812420] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-626f4e51-c3dc-4318-acdd-bb61945d5f1f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.812493] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-626f4e51-c3dc-4318-acdd-bb61945d5f1f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.812817] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-626f4e51-c3dc-4318-acdd-bb61945d5f1f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.813071] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.813203] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.813269] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.813438] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.813525] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.813625] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('626f4e51-c3dc-4318-acdd-bb61945d5f1f',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.817962] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5704e4e3-8211-4e30-b474-06c668cf060d in Status: SUCCESS [ 694.818275] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.818509] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.818720] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.818939] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.819069] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.819134] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.819295] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.819383] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.819483] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5704e4e3-8211-4e30-b474-06c668cf060d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.885025] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.885025] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.885025] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.885025] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.885025] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.885025] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 626f4e51-c3dc-4318-acdd-bb61945d5f1f is going to be deleted. [ 694.941295] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.941295] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.941295] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.941295] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.941295] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.941295] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.941295] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.941295] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.941295] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.941295] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.941295] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8fac3119-fae2-425a-a2df-e0fbbaa49c36 is going to be deleted. [ 694.969988] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.970210] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.970255] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.970449] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.970580] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.970673] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-626f4e51-c3dc-4318-acdd-bb61945d5f1f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.019244] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.019485] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.019580] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.019844] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.019968] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.020090] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8fac3119-fae2-425a-a2df-e0fbbaa49c36" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.020280] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8fac3119-fae2-425a-a2df-e0fbbaa49c36" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.020450] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8fac3119-fae2-425a-a2df-e0fbbaa49c36" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.020631] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.020763] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.020828] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.020974] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.021128] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.021229] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8fac3119-fae2-425a-a2df-e0fbbaa49c36',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.107382] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2d753783-8988-4639-a0fc-596bf03e413b',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.107874] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d753783-8988-4639-a0fc-596bf03e413b taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.108051] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d753783-8988-4639-a0fc-596bf03e413b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.108205] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9b6132da-2bf9-438f-ac9d-d02c8a902947 with status ACTIVE [ 695.108407] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.108532] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.108595] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.108880] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.108987] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.109215] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.109334] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.109393] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.111175] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.111175] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.111175] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.111175] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.111175] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.111175] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.111175] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.111175] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9b6132da-2bf9-438f-ac9d-d02c8a902947 is going to be updated. [ 695.140236] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.140439] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.140536] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.140850] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.141245] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.141377] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b6132da-2bf9-438f-ac9d-d02c8a902947" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.243555] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 in Status: SUCCESS [ 695.243776] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.244025] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.244294] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.244471] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.244590] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.244651] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.244810] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.245152] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.245260] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a595937-aa58-40f8-a3cf-b57a814011e8',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.316216] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.316465] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.316465] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.316728] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.316911] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.317140] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.317256] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.317314] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.317480] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.317563] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.317666] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 626f4e51-c3dc-4318-acdd-bb61945d5f1f is going to be deleted. [ 695.323584] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5704e4e3-8211-4e30-b474-06c668cf060d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.359465] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.359651] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.359700] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.359904] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.360019] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.360192] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-626f4e51-c3dc-4318-acdd-bb61945d5f1f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.360393] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-626f4e51-c3dc-4318-acdd-bb61945d5f1f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.360552] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-626f4e51-c3dc-4318-acdd-bb61945d5f1f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.360725] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.360830] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.360894] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.361046] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.361163] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.361348] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('626f4e51-c3dc-4318-acdd-bb61945d5f1f',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.524948] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.525146] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.525269] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.525470] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.525577] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.526010] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.526010] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.526151] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.526333] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.526423] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.526516] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8fac3119-fae2-425a-a2df-e0fbbaa49c36 already deleted. [ 695.527913] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8fac3119-fae2-425a-a2df-e0fbbaa49c36" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.527913] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8fac3119-fae2-425a-a2df-e0fbbaa49c36',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.527913] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8fac3119-fae2-425a-a2df-e0fbbaa49c36" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.527913] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8fac3119-fae2-425a-a2df-e0fbbaa49c36" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.528285] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.528285] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.528450] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.529284] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.529284] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.529284] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8fac3119-fae2-425a-a2df-e0fbbaa49c36',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.613422] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2d753783-8988-4639-a0fc-596bf03e413b',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.752414] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3a595937-aa58-40f8-a3cf-b57a814011e8',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.826946] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5704e4e3-8211-4e30-b474-06c668cf060d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.863382] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.863604] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.863703] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.863977] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.864124] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.864347] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.864486] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.864593] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.864793] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.864900] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.865013] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 626f4e51-c3dc-4318-acdd-bb61945d5f1f already deleted. [ 695.865133] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-626f4e51-c3dc-4318-acdd-bb61945d5f1f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.030621] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8fac3119-fae2-425a-a2df-e0fbbaa49c36',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.031810] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.031955] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.032039] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.032243] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.032329] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.032502] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.032596] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.032655] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.032794] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.032864] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.032943] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8fac3119-fae2-425a-a2df-e0fbbaa49c36 already deleted. [ 696.033030] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8fac3119-fae2-425a-a2df-e0fbbaa49c36" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.115934] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.115934] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.115934] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.116874] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.116874] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.116874] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d753783-8988-4639-a0fc-596bf03e413b is going to be created. [ 696.144522] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.144750] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.144750] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.144927] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.145098] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.158243] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d753783-8988-4639-a0fc-596bf03e413b in Status: UNINITIALIZED for 2s [ 696.254099] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3a595937-aa58-40f8-a3cf-b57a814011e8',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.329819] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.331028] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.331159] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.331462] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.331614] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.331774] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5704e4e3-8211-4e30-b474-06c668cf060d is going to be updated. [ 696.370258] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.370505] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.370578] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.371193] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.371193] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.386149] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5704e4e3-8211-4e30-b474-06c668cf060d in Status: IN_PROGRESS for 2s [ 696.535366] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8fac3119-fae2-425a-a2df-e0fbbaa49c36: rpc.has_security_group_logging(os_id): False [ 696.559314] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.559477] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.559568] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.559843] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.559979] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.560233] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.560330] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.560398] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.560562] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.560642] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.560730] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8fac3119-fae2-425a-a2df-e0fbbaa49c36 is going to be created. [ 696.593022] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/8fac3119-fae2-425a-a2df-e0fbbaa49c36], does not exist path=[/infra/domains/default/groups/8fac3119-fae2-425a-a2df-e0fbbaa49c36]."\n}' [ 696.593022] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8fac3119-fae2-425a-a2df-e0fbbaa49c36 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/8fac3119-fae2-425a-a2df-e0fbbaa49c36 [ 696.593022] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 696.641104] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.642304] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.644034] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.644034] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.644499] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.644955] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.645486] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.645694] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.648076] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.648076] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.648076] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.648076] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.648076] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.648076] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.648076] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.648076] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8fac3119-fae2-425a-a2df-e0fbbaa49c36 is going to be created. [ 696.676087] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/8fac3119-fae2-425a-a2df-e0fbbaa49c36], does not exist path=[/infra/domains/default/groups/8fac3119-fae2-425a-a2df-e0fbbaa49c36]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/8fac3119-fae2-425a-a2df-e0fbbaa49c36 [ 696.676276] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8fac3119-fae2-425a-a2df-e0fbbaa49c36" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.676968] env[62842]: Traceback (most recent call last): [ 696.677042] env[62842]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 696.677042] env[62842]: return func(*args, **kwargs) [ 696.677042] env[62842]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 696.677042] env[62842]: res.raise_for_status() [ 696.677042] env[62842]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 696.677042] env[62842]: raise HTTPError(http_error_msg, response=self) [ 696.677042] env[62842]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/8fac3119-fae2-425a-a2df-e0fbbaa49c36 [ 696.677042] env[62842]: During handling of the above exception, another exception occurred: [ 696.677042] env[62842]: Traceback (most recent call last): [ 696.677042] env[62842]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 696.677042] env[62842]: listener.cb(fileno) [ 696.677042] env[62842]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 696.677042] env[62842]: result = function(*args, **kwargs) [ 696.677042] env[62842]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 696.677042] env[62842]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 696.677524] env[62842]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 696.677524] env[62842]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 696.677524] env[62842]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 696.677524] env[62842]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 696.677524] env[62842]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 696.677524] env[62842]: res.raise_for_status() [ 696.677524] env[62842]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 696.677524] env[62842]: raise HTTPError(http_error_msg, response=self) [ 696.677524] env[62842]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/8fac3119-fae2-425a-a2df-e0fbbaa49c36 [ 696.677524] env[62842]: Removing descriptor: 19 [ 696.729816] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b321faa1-947f-4c79-ac72-202730c0dcd1 in Status: SUCCESS [ 696.730207] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b321faa1-947f-4c79-ac72-202730c0dcd1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.760243] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.760478] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.760478] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.760754] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.760846] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.760967] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 is going to be updated. [ 696.811902] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.812416] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.813366] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.813941] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.814332] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.835030] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 in Status: IN_PROGRESS for 2s [ 697.327364] env[62842]: INFO networking_nsxv3.common.synchronization [req-4fab64e5-0b79-4ade-a8ae-c3968cdb331d req-407d1785-8fdd-49d6-8eab-bb3b7d5780a4 tempest-ServersTestBootFromVolume-595571146 tempest-ServersTestBootFromVolume-595571146-project-member] Enqueued Resource ID: d1d35af8-d196-4dd3-b8df-9b98089c1606 with Priority: HIGHEST for action security_group_members [ 697.327364] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1d35af8-d196-4dd3-b8df-9b98089c1606 with Priority: HIGHEST for action security_group_members [ 697.328567] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1d35af8-d196-4dd3-b8df-9b98089c1606 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.329060] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1d35af8-d196-4dd3-b8df-9b98089c1606" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.331708] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1d35af8-d196-4dd3-b8df-9b98089c1606" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.331708] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1d35af8-d196-4dd3-b8df-9b98089c1606" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.331708] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.331708] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.331708] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.331708] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.331708] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.331708] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1d35af8-d196-4dd3-b8df-9b98089c1606',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.835616] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.836024] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.836024] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.836125] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.836221] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.836453] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.836518] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.836580] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.836749] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.836834] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.836922] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1d35af8-d196-4dd3-b8df-9b98089c1606 already deleted. [ 697.836990] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1d35af8-d196-4dd3-b8df-9b98089c1606" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.839128] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-713 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.839397] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-713" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.839533] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-713" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.839864] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-713" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.840165] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.840329] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.840516] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.840752] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.840901] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.841175] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 697.841303] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 697.841478] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 697.841656] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 697.841805] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 697.841922] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 697.842075] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 697.867434] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 697.867730] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 697.867952] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 697.868171] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-713" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.868669] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-37ef9838-a8c2-4b60-9515-0e6793088ead taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.868980] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-37ef9838-a8c2-4b60-9515-0e6793088ead" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.869130] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-37ef9838-a8c2-4b60-9515-0e6793088ead" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.869594] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-37ef9838-a8c2-4b60-9515-0e6793088ead" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.869756] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('37ef9838-a8c2-4b60-9515-0e6793088ead',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.170169] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d753783-8988-4639-a0fc-596bf03e413b in Status: SUCCESS [ 698.170308] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d753783-8988-4639-a0fc-596bf03e413b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.170500] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d753783-8988-4639-a0fc-596bf03e413b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.170808] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d753783-8988-4639-a0fc-596bf03e413b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.171058] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.171217] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.171398] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.171699] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.171789] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.172040] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d753783-8988-4639-a0fc-596bf03e413b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.172040] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2d753783-8988-4639-a0fc-596bf03e413b',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.372803] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.373056] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.373195] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.373460] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.373617] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.373773] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 37ef9838-a8c2-4b60-9515-0e6793088ead not found, creating... [ 698.374165] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.374300] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.374368] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.374535] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.374674] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.374962] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.375135] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.375256] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.375529] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.375619] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.375734] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 37ef9838-a8c2-4b60-9515-0e6793088ead is going to be created. [ 698.399281] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5704e4e3-8211-4e30-b474-06c668cf060d in Status: SUCCESS [ 698.399864] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.400144] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.400320] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.400518] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.400635] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.400784] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.400874] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.400961] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.401064] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.401278] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5704e4e3-8211-4e30-b474-06c668cf060d taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.401369] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.401421] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.401555] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.401693] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.401933] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.402016] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.402149] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.402227] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.402308] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.402395] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5704e4e3-8211-4e30-b474-06c668cf060d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.405465] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.405719] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.405856] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.406457] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.406457] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.406612] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-37ef9838-a8c2-4b60-9515-0e6793088ead" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.410494] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.410877] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.411531] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.411531] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.411688] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.412184] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.412184] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.412184] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5704e4e3-8211-4e30-b474-06c668cf060d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.675995] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2d753783-8988-4639-a0fc-596bf03e413b',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.847453] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 in Status: SUCCESS [ 698.847912] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.848026] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.848455] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.848757] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.849080] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.849171] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.849409] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.849551] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.849692] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.849957] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a595937-aa58-40f8-a3cf-b57a814011e8 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.850123] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.850248] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.850510] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.850739] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.850891] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.850992] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.851283] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.851416] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.851595] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.851740] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3a595937-aa58-40f8-a3cf-b57a814011e8',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.915084] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5704e4e3-8211-4e30-b474-06c668cf060d: rpc.has_security_group_logging(os_id): False [ 698.917039] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5704e4e3-8211-4e30-b474-06c668cf060d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.941478] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.941738] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.941861] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.942222] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.966935] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.967249] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.967427] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.967521] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.967825] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.967955] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.968292] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.968614] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.968614] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.968759] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.969129] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.969215] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.969347] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.970045] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.970045] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.970045] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.970045] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5704e4e3-8211-4e30-b474-06c668cf060d is going to be updated. [ 699.047721] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.047873] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.047919] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.048387] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.048387] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.076922] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5704e4e3-8211-4e30-b474-06c668cf060d in Status: IN_PROGRESS for 2s [ 699.135828] env[62842]: INFO networking_nsxv3.common.synchronization [req-4fab64e5-0b79-4ade-a8ae-c3968cdb331d req-09a8f7c6-b210-46b4-8f81-57aa3c68ab41 service nova] Enqueued Resource ID: d1d35af8-d196-4dd3-b8df-9b98089c1606 with Priority: HIGHEST for action security_group_rules [ 699.136051] env[62842]: INFO networking_nsxv3.common.synchronization [req-4fab64e5-0b79-4ade-a8ae-c3968cdb331d req-09a8f7c6-b210-46b4-8f81-57aa3c68ab41 service nova] Enqueued Resource ID: d1d35af8-d196-4dd3-b8df-9b98089c1606 with Priority: HIGHEST for action security_group_members [ 699.136200] env[62842]: INFO networking_nsxv3.common.synchronization [req-4fab64e5-0b79-4ade-a8ae-c3968cdb331d req-09a8f7c6-b210-46b4-8f81-57aa3c68ab41 service nova] Enqueued Resource ID: 37ef9838-a8c2-4b60-9515-0e6793088ead with Priority: HIGHEST for action port [ 699.136449] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1d35af8-d196-4dd3-b8df-9b98089c1606 with Priority: HIGHEST for action security_group_rules [ 699.136584] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1d35af8-d196-4dd3-b8df-9b98089c1606 with Priority: HIGHEST for action security_group_members [ 699.136681] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37ef9838-a8c2-4b60-9515-0e6793088ead with Priority: HIGHEST for action port [ 699.138650] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1d35af8-d196-4dd3-b8df-9b98089c1606 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.138650] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1d35af8-d196-4dd3-b8df-9b98089c1606" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.138650] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1d35af8-d196-4dd3-b8df-9b98089c1606" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.138650] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1d35af8-d196-4dd3-b8df-9b98089c1606" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.138650] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1d35af8-d196-4dd3-b8df-9b98089c1606',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.143161] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1d35af8-d196-4dd3-b8df-9b98089c1606 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.143161] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1d35af8-d196-4dd3-b8df-9b98089c1606" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.143161] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1d35af8-d196-4dd3-b8df-9b98089c1606" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.143161] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1d35af8-d196-4dd3-b8df-9b98089c1606" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.143161] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.143161] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.143161] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.143161] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.143161] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.143161] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1d35af8-d196-4dd3-b8df-9b98089c1606',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.143161] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-37ef9838-a8c2-4b60-9515-0e6793088ead taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.143161] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-37ef9838-a8c2-4b60-9515-0e6793088ead" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.143903] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-37ef9838-a8c2-4b60-9515-0e6793088ead" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.144253] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-37ef9838-a8c2-4b60-9515-0e6793088ead" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.144511] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('37ef9838-a8c2-4b60-9515-0e6793088ead',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.182548] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2d753783-8988-4639-a0fc-596bf03e413b: rpc.has_security_group_logging(os_id): False [ 699.204829] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.204829] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.204995] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.205182] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.205282] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.205552] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.205656] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.205720] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.205889] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.205965] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.206076] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d753783-8988-4639-a0fc-596bf03e413b is going to be created. [ 699.278956] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.278956] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.278956] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.278956] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.278956] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.298220] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d753783-8988-4639-a0fc-596bf03e413b in Status: IN_PROGRESS for 2s [ 699.354411] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3a595937-aa58-40f8-a3cf-b57a814011e8: rpc.has_security_group_logging(os_id): False [ 699.381650] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.381854] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.381854] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.382076] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.382212] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.382418] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.382545] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.382606] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.382742] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.382822] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.383015] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.383151] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.383151] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.383374] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.383494] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.383753] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.383893] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.383986] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.384194] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.384306] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.384436] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 is going to be created. [ 699.419148] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5704e4e3-8211-4e30-b474-06c668cf060d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.450891] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.451231] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.451231] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.452084] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.452084] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.467596] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 in Status: IN_PROGRESS for 2s [ 699.588847] env[62842]: INFO networking_nsxv3.common.synchronization [req-0bdfe240-2a32-4ff1-99f1-6c9a50c37f73 req-3a643e70-9848-4e5c-b7f0-bbcbaaa0a541 tempest-ServerRescueTestJSON-960362394 tempest-ServerRescueTestJSON-960362394-project-member] Enqueued Resource ID: e1bf27f4-91cf-44a6-8115-e3876163a888 with Priority: HIGHEST for action security_group_members [ 699.589482] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1bf27f4-91cf-44a6-8115-e3876163a888 with Priority: HIGHEST for action security_group_members [ 699.589803] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1bf27f4-91cf-44a6-8115-e3876163a888 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.589957] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.590050] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.590343] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.590509] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.590611] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.590683] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.590827] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.590919] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.591026] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e1bf27f4-91cf-44a6-8115-e3876163a888',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.647131] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d1d35af8-d196-4dd3-b8df-9b98089c1606',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.648362] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1d35af8-d196-4dd3-b8df-9b98089c1606 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.648985] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1d35af8-d196-4dd3-b8df-9b98089c1606" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.649642] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 37ef9838-a8c2-4b60-9515-0e6793088ead with status ACTIVE [ 699.649960] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.650152] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.650279] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.650537] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.650661] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.650882] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.651070] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.651192] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.651620] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.651744] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.652153] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.652304] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.652387] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.652575] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.652682] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.652798] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 37ef9838-a8c2-4b60-9515-0e6793088ead is going to be updated. [ 699.678608] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.678812] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.678907] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.679207] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.679430] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.679639] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-37ef9838-a8c2-4b60-9515-0e6793088ead" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.921807] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.922282] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.922282] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.922282] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.922482] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.922482] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5704e4e3-8211-4e30-b474-06c668cf060d is going to be updated. [ 699.938284] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-660 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.938484] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-660" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.938606] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-660" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.939177] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-660" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.939349] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.939511] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.939628] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.939926] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.940092] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.940236] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 699.940359] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 699.940444] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 699.940783] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 699.940783] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 699.940783] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 699.940950] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 699.972044] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 699.972313] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 699.972488] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 699.972790] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-660" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.973965] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-6ee1ec36-4c3c-4d1c-bf0a-f1a7c7d4da12 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.973965] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-6ee1ec36-4c3c-4d1c-bf0a-f1a7c7d4da12" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.973965] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-6ee1ec36-4c3c-4d1c-bf0a-f1a7c7d4da12" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.973965] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-6ee1ec36-4c3c-4d1c-bf0a-f1a7c7d4da12" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.973965] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ee1ec36-4c3c-4d1c-bf0a-f1a7c7d4da12',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.985907] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.987069] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.987251] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.987758] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.988011] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.002946] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5704e4e3-8211-4e30-b474-06c668cf060d in Status: IN_PROGRESS for 2s [ 700.093434] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.093662] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.093662] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.093884] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.094051] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.094324] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.094452] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.094452] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.094610] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.094690] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.094776] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1bf27f4-91cf-44a6-8115-e3876163a888 already deleted. [ 700.094855] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.149995] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d1d35af8-d196-4dd3-b8df-9b98089c1606',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.477079] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.477079] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.477079] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.477079] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.477079] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.477428] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 6ee1ec36-4c3c-4d1c-bf0a-f1a7c7d4da12 not found, creating... [ 700.477461] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.477682] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.477817] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.478054] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.478198] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.478481] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.478636] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.478752] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.478997] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.479147] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.479287] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 6ee1ec36-4c3c-4d1c-bf0a-f1a7c7d4da12 is going to be created. [ 700.501661] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.502044] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.502247] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.502488] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.502808] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.503081] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-6ee1ec36-4c3c-4d1c-bf0a-f1a7c7d4da12" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.652395] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.653225] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.653335] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.653527] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.653628] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.653735] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1d35af8-d196-4dd3-b8df-9b98089c1606 is going to be created. [ 700.694726] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.695000] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.695000] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.695335] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.695573] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.712381] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1d35af8-d196-4dd3-b8df-9b98089c1606 in Status: UNINITIALIZED for 2s [ 701.101307] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5704e4e3-8211-4e30-b474-06c668cf060d in Status: SUCCESS [ 701.101307] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.101307] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.101307] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.101307] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5704e4e3-8211-4e30-b474-06c668cf060d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.208055] env[62842]: INFO networking_nsxv3.common.synchronization [req-95cbe650-1b32-4979-a180-7bcbb2216b89 req-8b889016-8be5-4dee-82a7-cc2fa599c951 tempest-ListServersNegativeTestJSON-2108045219 tempest-ListServersNegativeTestJSON-2108045219-project-member] Enqueued Resource ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 with Priority: HIGHEST for action security_group_members [ 701.209665] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 with Priority: HIGHEST for action security_group_members [ 701.209665] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a595937-aa58-40f8-a3cf-b57a814011e8 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.209665] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.209665] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.209665] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.209901] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.209951] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.210314] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.210314] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.210686] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.210686] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a595937-aa58-40f8-a3cf-b57a814011e8',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.311090] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d753783-8988-4639-a0fc-596bf03e413b in Status: SUCCESS [ 701.311372] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d753783-8988-4639-a0fc-596bf03e413b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.350817] env[62842]: INFO networking_nsxv3.common.synchronization [req-0bdfe240-2a32-4ff1-99f1-6c9a50c37f73 req-ccbb52cb-e2f9-475d-84b0-e73bde2537b4 service nova] Enqueued Resource ID: e1bf27f4-91cf-44a6-8115-e3876163a888 with Priority: HIGHEST for action security_group_rules [ 701.351048] env[62842]: INFO networking_nsxv3.common.synchronization [req-0bdfe240-2a32-4ff1-99f1-6c9a50c37f73 req-ccbb52cb-e2f9-475d-84b0-e73bde2537b4 service nova] Enqueued Resource ID: e1bf27f4-91cf-44a6-8115-e3876163a888 with Priority: HIGHEST for action security_group_members [ 701.351212] env[62842]: INFO networking_nsxv3.common.synchronization [req-0bdfe240-2a32-4ff1-99f1-6c9a50c37f73 req-ccbb52cb-e2f9-475d-84b0-e73bde2537b4 service nova] Enqueued Resource ID: 6ee1ec36-4c3c-4d1c-bf0a-f1a7c7d4da12 with Priority: HIGHEST for action port [ 701.352824] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1bf27f4-91cf-44a6-8115-e3876163a888 with Priority: HIGHEST for action security_group_rules [ 701.352918] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1bf27f4-91cf-44a6-8115-e3876163a888 with Priority: HIGHEST for action security_group_members [ 701.353057] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ee1ec36-4c3c-4d1c-bf0a-f1a7c7d4da12 with Priority: HIGHEST for action port [ 701.353402] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e1bf27f4-91cf-44a6-8115-e3876163a888 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.353686] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.353780] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.354112] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.354336] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e1bf27f4-91cf-44a6-8115-e3876163a888',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.355263] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1bf27f4-91cf-44a6-8115-e3876163a888 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.355416] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.355638] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.355704] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.355906] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.356038] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.356128] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.356295] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.356442] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.356536] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e1bf27f4-91cf-44a6-8115-e3876163a888',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.357420] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ee1ec36-4c3c-4d1c-bf0a-f1a7c7d4da12 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.357515] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ee1ec36-4c3c-4d1c-bf0a-f1a7c7d4da12" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.357598] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ee1ec36-4c3c-4d1c-bf0a-f1a7c7d4da12" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.357768] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ee1ec36-4c3c-4d1c-bf0a-f1a7c7d4da12" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.357866] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ee1ec36-4c3c-4d1c-bf0a-f1a7c7d4da12',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.481811] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 in Status: SUCCESS [ 701.482055] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.482221] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.482441] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.483073] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a595937-aa58-40f8-a3cf-b57a814011e8',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.604239] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5704e4e3-8211-4e30-b474-06c668cf060d taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.604380] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.712506] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3a595937-aa58-40f8-a3cf-b57a814011e8',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.862108] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1bf27f4-91cf-44a6-8115-e3876163a888 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.862108] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.862108] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e1bf27f4-91cf-44a6-8115-e3876163a888',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.863141] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6ee1ec36-4c3c-4d1c-bf0a-f1a7c7d4da12 with status ACTIVE [ 701.863141] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.863141] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.863141] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.863141] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.863141] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.863141] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.863141] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.863501] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.863501] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.863501] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.863604] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.863677] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.863734] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.863865] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.863932] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.864068] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6ee1ec36-4c3c-4d1c-bf0a-f1a7c7d4da12 is going to be updated. [ 701.886783] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.887011] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.887011] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.887237] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.887375] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.888680] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ee1ec36-4c3c-4d1c-bf0a-f1a7c7d4da12" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.985160] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a595937-aa58-40f8-a3cf-b57a814011e8 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.985884] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.014286] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5704e4e3-8211-4e30-b474-06c668cf060d in Status: SUCCESS [ 702.014496] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.014658] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.014880] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.015090] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.015212] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.015272] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.015419] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.015503] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.015587] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.015683] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5704e4e3-8211-4e30-b474-06c668cf060d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.215401] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3a595937-aa58-40f8-a3cf-b57a814011e8',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.347079] env[62842]: INFO networking_nsxv3.common.synchronization [req-9f2418e7-a51e-4a66-a68d-37697ca087cc req-3afa9734-6df0-4926-ae69-afaa88ba5b7c tempest-ImagesOneServerTestJSON-464456993 tempest-ImagesOneServerTestJSON-464456993-project-member] Enqueued Resource ID: 37227a37-3f98-483a-add1-7f595a53cc2b with Priority: HIGHEST for action security_group_members [ 702.347410] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37227a37-3f98-483a-add1-7f595a53cc2b with Priority: HIGHEST for action security_group_members [ 702.347785] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-37227a37-3f98-483a-add1-7f595a53cc2b taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.347855] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37227a37-3f98-483a-add1-7f595a53cc2b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.347900] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37227a37-3f98-483a-add1-7f595a53cc2b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.348312] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37227a37-3f98-483a-add1-7f595a53cc2b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.348498] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.349573] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.349573] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.349573] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.349573] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.349573] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37227a37-3f98-483a-add1-7f595a53cc2b',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.369591] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e1bf27f4-91cf-44a6-8115-e3876163a888',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.518278] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5704e4e3-8211-4e30-b474-06c668cf060d taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.518452] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.518526] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.518749] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.518951] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.519068] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.519133] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.519282] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.519372] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.519462] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.519611] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5704e4e3-8211-4e30-b474-06c668cf060d taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.519703] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.519766] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.519915] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.520139] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.520139] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.520218] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.520334] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.520410] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.520491] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.520592] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5704e4e3-8211-4e30-b474-06c668cf060d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.718030] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.718253] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.718253] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.720022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.720022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.720022] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 is going to be updated. [ 702.721678] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1d35af8-d196-4dd3-b8df-9b98089c1606 in Status: SUCCESS [ 702.722389] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1d35af8-d196-4dd3-b8df-9b98089c1606" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.722596] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1d35af8-d196-4dd3-b8df-9b98089c1606" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.722800] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1d35af8-d196-4dd3-b8df-9b98089c1606" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.723014] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.723141] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.723209] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.725754] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.725754] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.725754] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1d35af8-d196-4dd3-b8df-9b98089c1606" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.725754] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d1d35af8-d196-4dd3-b8df-9b98089c1606',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.746244] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.746407] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.746473] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.746815] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.747016] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.758819] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 in Status: IN_PROGRESS for 2s [ 702.851460] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.851624] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.851692] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.851915] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.852234] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.852538] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.852789] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.852789] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.852971] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.854065] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.854065] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37227a37-3f98-483a-add1-7f595a53cc2b already deleted. [ 702.854065] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37227a37-3f98-483a-add1-7f595a53cc2b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.867866] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.868026] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.868079] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.868310] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.868358] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.868456] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1bf27f4-91cf-44a6-8115-e3876163a888 is going to be created. [ 702.905054] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.905054] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.905054] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.905054] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.905054] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.919362] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1bf27f4-91cf-44a6-8115-e3876163a888 in Status: UNINITIALIZED for 2s [ 703.023058] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5704e4e3-8211-4e30-b474-06c668cf060d: rpc.has_security_group_logging(os_id): False [ 703.043276] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.043575] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.043575] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.043796] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.043913] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.044184] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.044293] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.044357] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.044537] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.044627] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.044856] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.044979] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.045164] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.045335] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.045405] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.045596] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.045708] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.045774] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.045930] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.046041] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.046130] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5704e4e3-8211-4e30-b474-06c668cf060d is going to be updated. [ 703.106702] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-572 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.106921] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-572" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.107062] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-572" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.107405] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-572" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.107696] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.107851] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.107967] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.111908] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.112094] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.112324] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 703.112439] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 703.112553] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 703.112660] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 703.112769] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 703.112874] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 703.113025] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 703.134903] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 703.135094] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 703.135235] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 703.135429] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-572" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.135794] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-edfcc991-d031-4d6d-976f-17ae730cce59 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.135973] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-edfcc991-d031-4d6d-976f-17ae730cce59" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.136102] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-edfcc991-d031-4d6d-976f-17ae730cce59" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.136434] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-edfcc991-d031-4d6d-976f-17ae730cce59" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.136587] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('edfcc991-d031-4d6d-976f-17ae730cce59',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.138341] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.138464] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.138533] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.138790] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.139039] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.159783] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5704e4e3-8211-4e30-b474-06c668cf060d in Status: IN_PROGRESS for 2s [ 703.225969] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d1d35af8-d196-4dd3-b8df-9b98089c1606',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.641684] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.642050] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.642170] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.642538] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.642704] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.642907] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port edfcc991-d031-4d6d-976f-17ae730cce59 not found, creating... [ 703.643313] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.643557] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.643728] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.643993] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.644159] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.644474] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.644785] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.644964] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.645236] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.645391] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.645548] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: edfcc991-d031-4d6d-976f-17ae730cce59 is going to be created. [ 703.673557] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.673790] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.674044] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.674278] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.674473] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.674791] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-edfcc991-d031-4d6d-976f-17ae730cce59" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.729399] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d1d35af8-d196-4dd3-b8df-9b98089c1606: rpc.has_security_group_logging(os_id): False [ 703.751328] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.751699] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.751699] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.751699] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.752024] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.752024] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.752957] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.752957] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.752957] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.752957] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.752957] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1d35af8-d196-4dd3-b8df-9b98089c1606 is going to be created. [ 703.887197] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.887345] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.887438] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.887677] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.887872] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.900039] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d1d35af8-d196-4dd3-b8df-9b98089c1606 in Status: IN_PROGRESS for 2s [ 704.633028] env[62842]: INFO networking_nsxv3.common.synchronization [req-83c7c0c1-6b17-48cd-aaa1-ecf285468d53 req-b97a0b98-aac6-40a5-9322-0ba3c624031a tempest-AttachInterfacesV270Test-844636407 tempest-AttachInterfacesV270Test-844636407-project-member] Enqueued Resource ID: b321faa1-947f-4c79-ac72-202730c0dcd1 with Priority: HIGHEST for action security_group_members [ 704.633598] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b321faa1-947f-4c79-ac72-202730c0dcd1 with Priority: HIGHEST for action security_group_members [ 704.633910] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-b321faa1-947f-4c79-ac72-202730c0dcd1 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.634032] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b321faa1-947f-4c79-ac72-202730c0dcd1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.634101] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b321faa1-947f-4c79-ac72-202730c0dcd1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.634298] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b321faa1-947f-4c79-ac72-202730c0dcd1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.634451] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.634547] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.634608] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.634748] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.635132] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.635132] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b321faa1-947f-4c79-ac72-202730c0dcd1',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.771333] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 in Status: SUCCESS [ 704.771333] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.771333] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.771868] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.771868] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.771868] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.771995] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.772532] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.772632] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.772743] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.772839] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3a595937-aa58-40f8-a3cf-b57a814011e8',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.794523] env[62842]: INFO networking_nsxv3.common.synchronization [req-9f2418e7-a51e-4a66-a68d-37697ca087cc req-7b7fa34a-cf94-4f42-8508-da7ed35d9f9a service nova] Enqueued Resource ID: 37227a37-3f98-483a-add1-7f595a53cc2b with Priority: HIGHEST for action security_group_rules [ 704.794693] env[62842]: INFO networking_nsxv3.common.synchronization [req-9f2418e7-a51e-4a66-a68d-37697ca087cc req-7b7fa34a-cf94-4f42-8508-da7ed35d9f9a service nova] Enqueued Resource ID: 37227a37-3f98-483a-add1-7f595a53cc2b with Priority: HIGHEST for action security_group_members [ 704.794871] env[62842]: INFO networking_nsxv3.common.synchronization [req-9f2418e7-a51e-4a66-a68d-37697ca087cc req-7b7fa34a-cf94-4f42-8508-da7ed35d9f9a service nova] Enqueued Resource ID: edfcc991-d031-4d6d-976f-17ae730cce59 with Priority: HIGHEST for action port [ 704.795099] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37227a37-3f98-483a-add1-7f595a53cc2b with Priority: HIGHEST for action security_group_rules [ 704.795264] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37227a37-3f98-483a-add1-7f595a53cc2b with Priority: HIGHEST for action security_group_members [ 704.795365] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edfcc991-d031-4d6d-976f-17ae730cce59 with Priority: HIGHEST for action port [ 704.796584] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37227a37-3f98-483a-add1-7f595a53cc2b taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.796721] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37227a37-3f98-483a-add1-7f595a53cc2b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.796787] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37227a37-3f98-483a-add1-7f595a53cc2b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.797097] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37227a37-3f98-483a-add1-7f595a53cc2b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.797183] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37227a37-3f98-483a-add1-7f595a53cc2b',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.798122] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-37227a37-3f98-483a-add1-7f595a53cc2b taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.798239] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37227a37-3f98-483a-add1-7f595a53cc2b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.798320] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37227a37-3f98-483a-add1-7f595a53cc2b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.798501] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37227a37-3f98-483a-add1-7f595a53cc2b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.798970] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.798970] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.798970] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.799744] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.800028] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.800028] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37227a37-3f98-483a-add1-7f595a53cc2b',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.800872] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-edfcc991-d031-4d6d-976f-17ae730cce59 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.800982] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-edfcc991-d031-4d6d-976f-17ae730cce59" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.801049] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-edfcc991-d031-4d6d-976f-17ae730cce59" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.802520] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-edfcc991-d031-4d6d-976f-17ae730cce59" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.802520] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('edfcc991-d031-4d6d-976f-17ae730cce59',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.935182] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1bf27f4-91cf-44a6-8115-e3876163a888 in Status: SUCCESS [ 704.936517] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.936517] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.936517] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.936834] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.936976] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.937063] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.937271] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.937358] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.937467] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.937557] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e1bf27f4-91cf-44a6-8115-e3876163a888',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.095414] env[62842]: INFO networking_nsxv3.common.synchronization [None req-33ca05ad-106a-440c-9c89-bf2fb41ec274 tempest-AttachVolumeNegativeTest-1420230652 tempest-AttachVolumeNegativeTest-1420230652-project-member] Enqueued Resource ID: 1669144b-ae4c-489e-95db-13be5c3bfb22 with Priority: HIGHEST for action security_group_rules [ 705.095900] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1669144b-ae4c-489e-95db-13be5c3bfb22 with Priority: HIGHEST for action security_group_rules [ 705.096306] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1669144b-ae4c-489e-95db-13be5c3bfb22 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.096387] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1669144b-ae4c-489e-95db-13be5c3bfb22" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.097188] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1669144b-ae4c-489e-95db-13be5c3bfb22" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.097188] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1669144b-ae4c-489e-95db-13be5c3bfb22" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.097293] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1669144b-ae4c-489e-95db-13be5c3bfb22',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.142128] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.142128] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.142128] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.142128] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.169994] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.170375] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.170533] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.170632] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.170896] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.170998] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.171126] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b321faa1-947f-4c79-ac72-202730c0dcd1 is going to be updated. [ 705.186780] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5704e4e3-8211-4e30-b474-06c668cf060d in Status: SUCCESS [ 705.186780] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.207609] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.207778] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.207819] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.210283] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.210283] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.214926] env[62842]: INFO networking_nsxv3.common.synchronization [None req-367e6866-0679-4b8e-8a48-ac60eabfca4e tempest-AttachVolumeNegativeTest-1420230652 tempest-AttachVolumeNegativeTest-1420230652-project-member] Enqueued Resource ID: 1669144b-ae4c-489e-95db-13be5c3bfb22 with Priority: HIGHEST for action security_group_rules [ 705.215515] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1669144b-ae4c-489e-95db-13be5c3bfb22 with Priority: HIGHEST for action security_group_rules [ 705.215941] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1669144b-ae4c-489e-95db-13be5c3bfb22 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.216221] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1669144b-ae4c-489e-95db-13be5c3bfb22" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.226358] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b321faa1-947f-4c79-ac72-202730c0dcd1 in Status: IN_PROGRESS for 2s [ 705.275750] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a595937-aa58-40f8-a3cf-b57a814011e8 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.275927] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.275995] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.276215] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.276401] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.276499] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.276557] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.276710] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.276796] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.276884] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.277043] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a595937-aa58-40f8-a3cf-b57a814011e8 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.277146] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.277197] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.277324] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.277455] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.277545] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.277604] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.277737] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.277811] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.277891] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.277980] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3a595937-aa58-40f8-a3cf-b57a814011e8',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.303313] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-37227a37-3f98-483a-add1-7f595a53cc2b taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.303441] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37227a37-3f98-483a-add1-7f595a53cc2b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.308194] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('37227a37-3f98-483a-add1-7f595a53cc2b',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.308194] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port edfcc991-d031-4d6d-976f-17ae730cce59 with status ACTIVE [ 705.308356] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.308421] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.308456] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.308735] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.308735] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.309025] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.309099] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.309161] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.309330] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.309408] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.309608] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.309685] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.309735] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.309859] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.309928] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.310017] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: edfcc991-d031-4d6d-976f-17ae730cce59 is going to be updated. [ 705.348304] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.348304] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.348304] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.348304] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.348304] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.348304] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-edfcc991-d031-4d6d-976f-17ae730cce59" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.441238] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1bf27f4-91cf-44a6-8115-e3876163a888 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.441404] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.441477] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.441701] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.441906] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.442073] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.442229] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.442265] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.442340] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.442428] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.442579] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1bf27f4-91cf-44a6-8115-e3876163a888 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.442672] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.442734] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.442873] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.443031] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.443146] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.443189] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.443349] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.443431] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.443526] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.443616] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e1bf27f4-91cf-44a6-8115-e3876163a888',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.623547] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.623691] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.623760] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.624086] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.624086] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.624168] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1669144b-ae4c-489e-95db-13be5c3bfb22 already deleted. [ 705.624246] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1669144b-ae4c-489e-95db-13be5c3bfb22" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.624384] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1669144b-ae4c-489e-95db-13be5c3bfb22" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.624549] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1669144b-ae4c-489e-95db-13be5c3bfb22" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.624635] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1669144b-ae4c-489e-95db-13be5c3bfb22',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.781325] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3a595937-aa58-40f8-a3cf-b57a814011e8: rpc.has_security_group_logging(os_id): False [ 705.801404] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.801605] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.801675] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.801837] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.801934] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.802164] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.802265] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.802320] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.802469] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.802572] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.802723] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.802812] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.802871] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.803015] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.803096] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.803309] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.803816] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.803816] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.803816] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.803816] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.803816] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 is going to be updated. [ 705.811995] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('37227a37-3f98-483a-add1-7f595a53cc2b',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.870386] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.872077] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.872077] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.872077] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.872077] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.889227] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 in Status: IN_PROGRESS for 2s [ 705.947626] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e1bf27f4-91cf-44a6-8115-e3876163a888: rpc.has_security_group_logging(os_id): False [ 706.006447] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d1d35af8-d196-4dd3-b8df-9b98089c1606 in Status: SUCCESS [ 706.006447] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1d35af8-d196-4dd3-b8df-9b98089c1606" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.011878] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.012074] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.012122] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.012314] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.012403] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.012804] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.012804] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.012804] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.013045] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.013045] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.013160] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.013254] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.013315] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.013470] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.013542] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.013732] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.013825] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.013886] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.014245] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.014411] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.014529] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e1bf27f4-91cf-44a6-8115-e3876163a888 is going to be created. [ 706.099292] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.099380] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.099483] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.099789] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.100086] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.114204] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e1bf27f4-91cf-44a6-8115-e3876163a888 in Status: IN_PROGRESS for 2s [ 706.149954] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.149954] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.149954] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.150203] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.150299] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.150555] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1669144b-ae4c-489e-95db-13be5c3bfb22 already deleted. [ 706.150555] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1669144b-ae4c-489e-95db-13be5c3bfb22" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.315865] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.316099] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.316142] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.316353] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.316444] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.316545] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37227a37-3f98-483a-add1-7f595a53cc2b is going to be created. [ 706.351927] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.352145] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.352145] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.352480] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.352546] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.377476] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37227a37-3f98-483a-add1-7f595a53cc2b in Status: UNINITIALIZED for 2s [ 706.694101] env[62842]: INFO networking_nsxv3.common.synchronization [req-6fcef0ed-99ba-4598-9e35-f2ea21319a18 req-5684b99d-2c69-4b4b-9fc9-32ab64693ca4 tempest-ListImageFiltersTestJSON-20601446 tempest-ListImageFiltersTestJSON-20601446-project-member] Enqueued Resource ID: fe43e864-555f-4ea5-8841-d2bcacb15ecc with Priority: HIGHEST for action security_group_members [ 706.695095] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe43e864-555f-4ea5-8841-d2bcacb15ecc with Priority: HIGHEST for action security_group_members [ 706.696309] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe43e864-555f-4ea5-8841-d2bcacb15ecc taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.700436] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.700436] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.700436] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.700436] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.700436] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.700436] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.700436] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.700436] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.700436] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe43e864-555f-4ea5-8841-d2bcacb15ecc',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.200880] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fe43e864-555f-4ea5-8841-d2bcacb15ecc',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.236709] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b321faa1-947f-4c79-ac72-202730c0dcd1 in Status: SUCCESS [ 707.237279] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b321faa1-947f-4c79-ac72-202730c0dcd1 deletion is rescheduled due to dependency. [ 707.238201] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b321faa1-947f-4c79-ac72-202730c0dcd1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.702811] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fe43e864-555f-4ea5-8841-d2bcacb15ecc',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.910165] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 in Status: SUCCESS [ 707.910165] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.910165] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.910165] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.910165] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a595937-aa58-40f8-a3cf-b57a814011e8',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.130321] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e1bf27f4-91cf-44a6-8115-e3876163a888 in Status: SUCCESS [ 708.130321] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.206709] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.207024] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.207024] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.207456] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.207456] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.207456] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe43e864-555f-4ea5-8841-d2bcacb15ecc is going to be updated. [ 708.239435] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.239637] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.239637] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.240322] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.240322] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.250484] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe43e864-555f-4ea5-8841-d2bcacb15ecc in Status: IN_PROGRESS for 2s [ 708.389945] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37227a37-3f98-483a-add1-7f595a53cc2b in Status: SUCCESS [ 708.389945] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37227a37-3f98-483a-add1-7f595a53cc2b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.389945] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37227a37-3f98-483a-add1-7f595a53cc2b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.389945] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37227a37-3f98-483a-add1-7f595a53cc2b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.390192] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.390647] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.390647] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.390647] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.390647] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.390647] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37227a37-3f98-483a-add1-7f595a53cc2b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.390850] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('37227a37-3f98-483a-add1-7f595a53cc2b',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.411649] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a595937-aa58-40f8-a3cf-b57a814011e8 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.411736] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.411808] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.412061] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.412291] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.412395] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.412470] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.412624] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.412707] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.412790] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.412876] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3a595937-aa58-40f8-a3cf-b57a814011e8',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.896063] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-37227a37-3f98-483a-add1-7f595a53cc2b taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.896220] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37227a37-3f98-483a-add1-7f595a53cc2b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.896292] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37227a37-3f98-483a-add1-7f595a53cc2b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.896539] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37227a37-3f98-483a-add1-7f595a53cc2b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.896735] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.896884] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.896955] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.897134] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.897341] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.897341] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37227a37-3f98-483a-add1-7f595a53cc2b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.897463] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-37227a37-3f98-483a-add1-7f595a53cc2b taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.897550] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37227a37-3f98-483a-add1-7f595a53cc2b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.897607] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37227a37-3f98-483a-add1-7f595a53cc2b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.897743] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37227a37-3f98-483a-add1-7f595a53cc2b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.897876] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.898586] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.898586] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.898586] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.898586] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.898586] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37227a37-3f98-483a-add1-7f595a53cc2b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.898586] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('37227a37-3f98-483a-add1-7f595a53cc2b',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.916025] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a595937-aa58-40f8-a3cf-b57a814011e8 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.916267] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.916390] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.916671] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.916923] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.917078] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.917184] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.917409] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.917553] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.917704] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.917944] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a595937-aa58-40f8-a3cf-b57a814011e8 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.918111] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.918213] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.919136] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.919301] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.919421] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.919488] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.919683] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.919818] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.919961] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.920872] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3a595937-aa58-40f8-a3cf-b57a814011e8',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.404092] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 37227a37-3f98-483a-add1-7f595a53cc2b: rpc.has_security_group_logging(os_id): False [ 709.423306] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3a595937-aa58-40f8-a3cf-b57a814011e8: rpc.has_security_group_logging(os_id): False [ 709.425491] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.425632] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.425718] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.425910] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.426123] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.426319] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.426418] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.426473] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.426727] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.426835] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.427135] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.427239] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.427551] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.427722] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.427802] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.428009] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.428168] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.428242] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.428375] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.428448] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.428677] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37227a37-3f98-483a-add1-7f595a53cc2b is going to be created. [ 709.448980] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.449215] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.449556] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.449829] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.449942] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.450192] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.450314] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.450555] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.450555] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.450651] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.450801] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.450891] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.452669] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.452869] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.452970] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.453279] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.453438] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.453438] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.453568] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.453660] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.453763] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 is going to be updated. [ 709.500388] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.500566] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.501883] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.501883] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.501883] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.514029] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37227a37-3f98-483a-add1-7f595a53cc2b in Status: IN_PROGRESS for 2s [ 709.523026] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.523026] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.523026] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.523026] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.523026] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.550746] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 in Status: IN_PROGRESS for 2s [ 710.265620] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe43e864-555f-4ea5-8841-d2bcacb15ecc in Status: SUCCESS [ 710.268121] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.320889] env[62842]: INFO networking_nsxv3.common.synchronization [req-9cba8c22-ae6f-41bb-bbc8-30152de48ba7 req-ba2083c5-cbc5-4685-9c9a-1fdf87e4ef98 tempest-ListServerFiltersTestJSON-2112811092 tempest-ListServerFiltersTestJSON-2112811092-project-member] Enqueued Resource ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 with Priority: HIGHEST for action security_group_members [ 710.321483] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 with Priority: HIGHEST for action security_group_members [ 710.322851] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-331dd47d-e3b4-4338-b588-cd456a9aa5f7 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.322911] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.323956] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.323956] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.323956] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.323956] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.323956] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.323956] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.323956] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.324421] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('331dd47d-e3b4-4338-b588-cd456a9aa5f7',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.826038] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.826431] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.826431] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.826617] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.850034] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.850034] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.850171] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.850238] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.850533] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.850533] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.850533] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 is going to be updated. [ 710.884430] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.884595] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.884648] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.884835] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.884979] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.895009] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 in Status: IN_PROGRESS for 2s [ 711.528973] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37227a37-3f98-483a-add1-7f595a53cc2b in Status: SUCCESS [ 711.533056] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37227a37-3f98-483a-add1-7f595a53cc2b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.565938] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 in Status: SUCCESS [ 711.566196] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.544403] env[62842]: INFO networking_nsxv3.common.synchronization [None req-d20eaed9-98ba-4b2e-88a1-89a3e1f3df30 None None] Enqueued Resource ID: dfe86e80-48ac-4ef2-b73e-f54380b3dae8 with Priority: HIGHEST for action port [ 712.544403] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfe86e80-48ac-4ef2-b73e-f54380b3dae8 with Priority: HIGHEST for action port [ 712.544403] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-dfe86e80-48ac-4ef2-b73e-f54380b3dae8 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.544403] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dfe86e80-48ac-4ef2-b73e-f54380b3dae8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.544403] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dfe86e80-48ac-4ef2-b73e-f54380b3dae8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.547104] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dfe86e80-48ac-4ef2-b73e-f54380b3dae8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.549576] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dfe86e80-48ac-4ef2-b73e-f54380b3dae8',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.711640] env[62842]: INFO networking_nsxv3.common.synchronization [req-ed1a0d84-d140-4ae2-820e-df7f3a0bd654 req-fbb99fa8-eb88-4cc5-acbb-2627cb3aad5f tempest-ImagesOneServerNegativeTestJSON-864549307 tempest-ImagesOneServerNegativeTestJSON-864549307-project-member] Enqueued Resource ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd with Priority: HIGHEST for action security_group_members [ 712.712417] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd with Priority: HIGHEST for action security_group_members [ 712.713400] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.716241] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.716241] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.716241] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.716241] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.716241] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.716241] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.716241] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.716241] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.716241] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('82e532f4-b8b0-4a4a-affc-1ab5a63253cd',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.907476] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 in Status: SUCCESS [ 712.909720] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 deletion is rescheduled due to dependency. [ 712.909720] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.050061] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dfe86e80-48ac-4ef2-b73e-f54380b3dae8 [ 713.052213] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.052213] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.052213] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.052213] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.052213] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.052213] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dfe86e80-48ac-4ef2-b73e-f54380b3dae8 already deleted. [ 713.052213] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dfe86e80-48ac-4ef2-b73e-f54380b3dae8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.221320] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.221558] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.221558] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.221749] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.221836] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.222050] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.222176] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.222267] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.222465] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.222546] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.222638] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd already deleted. [ 713.222742] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.476037] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-821 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.476037] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-821" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.476037] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-821" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.476037] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-821" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.476037] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.476037] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.476037] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.476037] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.480787] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.480787] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 713.480787] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 713.480787] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 713.480787] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 713.480787] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 713.480787] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 713.480787] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 713.501301] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 713.501414] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 713.501566] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 713.501859] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-821" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.502213] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-725739d1-3696-4c4c-a7e9-ab6aab10d5ef taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.502423] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-725739d1-3696-4c4c-a7e9-ab6aab10d5ef" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.502640] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-725739d1-3696-4c4c-a7e9-ab6aab10d5ef" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.502805] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-725739d1-3696-4c4c-a7e9-ab6aab10d5ef" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.502937] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('725739d1-3696-4c4c-a7e9-ab6aab10d5ef',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.576019] env[62842]: INFO networking_nsxv3.common.synchronization [None req-8b69d434-4442-4d0e-9b06-df4144a27ec1 None None] Enqueued Resource ID: 74911228-6045-4a4a-8749-520e3fbdb358 with Priority: HIGHEST for action port [ 713.576019] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74911228-6045-4a4a-8749-520e3fbdb358 with Priority: HIGHEST for action port [ 713.576019] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-74911228-6045-4a4a-8749-520e3fbdb358 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.576019] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74911228-6045-4a4a-8749-520e3fbdb358" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.576019] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74911228-6045-4a4a-8749-520e3fbdb358" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.576019] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74911228-6045-4a4a-8749-520e3fbdb358" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.576019] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74911228-6045-4a4a-8749-520e3fbdb358',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.006111] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.006388] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.006567] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.006902] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.007091] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.007278] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 725739d1-3696-4c4c-a7e9-ab6aab10d5ef not found, creating... [ 714.007663] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.007938] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.008155] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.008465] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.008616] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.009737] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.009966] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.010131] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.010675] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.010877] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.011054] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 725739d1-3696-4c4c-a7e9-ab6aab10d5ef is going to be created. [ 714.033600] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.033861] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.034013] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.034600] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.034890] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.035182] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-725739d1-3696-4c4c-a7e9-ab6aab10d5ef" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.079542] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 74911228-6045-4a4a-8749-520e3fbdb358 [ 714.079542] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.079542] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.079542] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.079899] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.079899] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.079971] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:74911228-6045-4a4a-8749-520e3fbdb358 already deleted. [ 714.080016] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74911228-6045-4a4a-8749-520e3fbdb358" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.598387] env[62842]: INFO networking_nsxv3.common.synchronization [None req-d5e532f6-4684-48a1-a401-1fcdbf0f4c6e tempest-ServersTestManualDisk-131723153 tempest-ServersTestManualDisk-131723153-project-member] Enqueued Resource ID: eb447582-c572-481b-befa-98a3dcf064c3 with Priority: HIGHEST for action security_group_rules [ 714.599032] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb447582-c572-481b-befa-98a3dcf064c3 with Priority: HIGHEST for action security_group_rules [ 714.599363] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb447582-c572-481b-befa-98a3dcf064c3 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.599784] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb447582-c572-481b-befa-98a3dcf064c3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.599784] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb447582-c572-481b-befa-98a3dcf064c3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.599784] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb447582-c572-481b-befa-98a3dcf064c3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.599977] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb447582-c572-481b-befa-98a3dcf064c3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.780725] env[62842]: INFO networking_nsxv3.common.synchronization [req-263945b0-5269-46b0-b0be-646724730d57 req-a2ca9d6b-3e9b-48fd-bf98-f1648c412d80 tempest-ServersAdminTestJSON-1475908229 tempest-ServersAdminTestJSON-1475908229-project-member] Enqueued Resource ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e with Priority: HIGHEST for action security_group_members [ 714.781603] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e with Priority: HIGHEST for action security_group_members [ 714.781790] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.783186] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.783186] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.786033] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.786033] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.786033] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.786033] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.786033] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.786033] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.786033] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7acb0f4-6157-4a0c-977e-ee6a2808aa0e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.788824] env[62842]: INFO networking_nsxv3.common.synchronization [None req-584137a7-1ef3-4780-a2e7-f3d14da7acfc None None] Enqueued Resource ID: 3617f519-e0c2-4be1-8e9c-8030ca0cac13 with Priority: HIGHEST for action port [ 714.789012] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3617f519-e0c2-4be1-8e9c-8030ca0cac13 with Priority: HIGHEST for action port [ 714.789415] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-3617f519-e0c2-4be1-8e9c-8030ca0cac13 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.789750] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3617f519-e0c2-4be1-8e9c-8030ca0cac13" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.789750] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3617f519-e0c2-4be1-8e9c-8030ca0cac13" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.790442] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3617f519-e0c2-4be1-8e9c-8030ca0cac13" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.790442] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3617f519-e0c2-4be1-8e9c-8030ca0cac13',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.804571] env[62842]: INFO networking_nsxv3.common.synchronization [None req-73855ad9-ab65-4fb6-8291-3aa099c01dcd tempest-ServersTestManualDisk-131723153 tempest-ServersTestManualDisk-131723153-project-member] Enqueued Resource ID: eb447582-c572-481b-befa-98a3dcf064c3 with Priority: HIGHEST for action security_group_rules [ 714.805548] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb447582-c572-481b-befa-98a3dcf064c3 with Priority: HIGHEST for action security_group_rules [ 714.805978] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb447582-c572-481b-befa-98a3dcf064c3 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.806130] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb447582-c572-481b-befa-98a3dcf064c3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.122746] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.122920] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.122963] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.123603] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.123603] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.123603] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb447582-c572-481b-befa-98a3dcf064c3 already deleted. [ 715.123603] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb447582-c572-481b-befa-98a3dcf064c3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.123835] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb447582-c572-481b-befa-98a3dcf064c3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.123917] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb447582-c572-481b-befa-98a3dcf064c3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.123951] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb447582-c572-481b-befa-98a3dcf064c3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.265098] env[62842]: INFO networking_nsxv3.common.synchronization [req-ed1a0d84-d140-4ae2-820e-df7f3a0bd654 req-19ad4a73-53d9-4fa4-a97e-64b40a0fd415 service nova] Enqueued Resource ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd with Priority: HIGHEST for action security_group_rules [ 715.265323] env[62842]: INFO networking_nsxv3.common.synchronization [req-ed1a0d84-d140-4ae2-820e-df7f3a0bd654 req-19ad4a73-53d9-4fa4-a97e-64b40a0fd415 service nova] Enqueued Resource ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd with Priority: HIGHEST for action security_group_members [ 715.265466] env[62842]: INFO networking_nsxv3.common.synchronization [req-ed1a0d84-d140-4ae2-820e-df7f3a0bd654 req-19ad4a73-53d9-4fa4-a97e-64b40a0fd415 service nova] Enqueued Resource ID: 725739d1-3696-4c4c-a7e9-ab6aab10d5ef with Priority: HIGHEST for action port [ 715.265802] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd with Priority: HIGHEST for action security_group_rules [ 715.265865] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd with Priority: HIGHEST for action security_group_members [ 715.265955] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 725739d1-3696-4c4c-a7e9-ab6aab10d5ef with Priority: HIGHEST for action port [ 715.269523] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-82e532f4-b8b0-4a4a-affc-1ab5a63253cd taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.269523] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.269523] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.269523] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.269523] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('82e532f4-b8b0-4a4a-affc-1ab5a63253cd',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.269523] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.269523] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.269523] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.269998] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.269998] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.269998] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.269998] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.270185] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.270604] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.270604] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('82e532f4-b8b0-4a4a-affc-1ab5a63253cd',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.271951] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-725739d1-3696-4c4c-a7e9-ab6aab10d5ef taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.272242] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-725739d1-3696-4c4c-a7e9-ab6aab10d5ef" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.272869] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-725739d1-3696-4c4c-a7e9-ab6aab10d5ef" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.272869] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-725739d1-3696-4c4c-a7e9-ab6aab10d5ef" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.272869] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('725739d1-3696-4c4c-a7e9-ab6aab10d5ef',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.287675] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e7acb0f4-6157-4a0c-977e-ee6a2808aa0e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.292656] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3617f519-e0c2-4be1-8e9c-8030ca0cac13 [ 715.294034] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.294034] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.294034] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.294034] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.294034] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.294034] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3617f519-e0c2-4be1-8e9c-8030ca0cac13 already deleted. [ 715.294034] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3617f519-e0c2-4be1-8e9c-8030ca0cac13" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.620566] env[62842]: INFO networking_nsxv3.common.synchronization [None req-ed9b7f59-8185-4566-b39d-7f9ad61f6e54 None None] Enqueued Resource ID: 437d1a51-22fc-4d08-830a-bc72598ca42f with Priority: HIGHEST for action port [ 715.620566] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 437d1a51-22fc-4d08-830a-bc72598ca42f with Priority: HIGHEST for action port [ 715.620566] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-437d1a51-22fc-4d08-830a-bc72598ca42f taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.620566] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-437d1a51-22fc-4d08-830a-bc72598ca42f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.620566] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-437d1a51-22fc-4d08-830a-bc72598ca42f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.620566] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-437d1a51-22fc-4d08-830a-bc72598ca42f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.620566] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('437d1a51-22fc-4d08-830a-bc72598ca42f',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.650958] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.650958] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.650958] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.650958] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.650958] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.650958] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb447582-c572-481b-befa-98a3dcf064c3 already deleted. [ 715.650958] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb447582-c572-481b-befa-98a3dcf064c3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.707068] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-988 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.707273] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-988" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.708009] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-988" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.708009] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-988" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.708009] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.708180] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.708360] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.710836] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.710836] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.710836] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 715.710836] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 715.711023] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 715.711135] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 715.711235] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 715.712914] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 715.712914] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 715.732051] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 715.732181] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 715.732260] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 715.732419] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-988" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.733193] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-58006e23-f2a3-4f65-bc77-566d880ffbe6 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.733193] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-58006e23-f2a3-4f65-bc77-566d880ffbe6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.733193] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-58006e23-f2a3-4f65-bc77-566d880ffbe6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.733449] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-58006e23-f2a3-4f65-bc77-566d880ffbe6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.733497] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58006e23-f2a3-4f65-bc77-566d880ffbe6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.774604] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.774795] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.777035] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('82e532f4-b8b0-4a4a-affc-1ab5a63253cd',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.777035] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 725739d1-3696-4c4c-a7e9-ab6aab10d5ef with status ACTIVE [ 715.777035] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.777035] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.777035] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.777331] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.777449] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.777619] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.777715] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.777794] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.778019] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.778160] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.778400] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.778522] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.778795] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.779045] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.779159] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.779274] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 725739d1-3696-4c4c-a7e9-ab6aab10d5ef is going to be updated. [ 715.791416] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e7acb0f4-6157-4a0c-977e-ee6a2808aa0e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.801301] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.801473] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.801524] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.802093] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.802093] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.802093] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-725739d1-3696-4c4c-a7e9-ab6aab10d5ef" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.130547] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 437d1a51-22fc-4d08-830a-bc72598ca42f [ 716.130781] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.130912] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.130987] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.131220] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.131317] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.131413] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:437d1a51-22fc-4d08-830a-bc72598ca42f already deleted. [ 716.131494] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-437d1a51-22fc-4d08-830a-bc72598ca42f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.236837] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.236837] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.236837] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.236837] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.236837] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.236837] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 58006e23-f2a3-4f65-bc77-566d880ffbe6 not found, creating... [ 716.237312] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.237312] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.237312] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.237485] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.237624] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.237903] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.238071] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.238191] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.238396] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.238529] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.238666] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 58006e23-f2a3-4f65-bc77-566d880ffbe6 is going to be created. [ 716.259988] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.260895] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.260895] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.260895] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.260895] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.261094] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-58006e23-f2a3-4f65-bc77-566d880ffbe6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.277039] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('82e532f4-b8b0-4a4a-affc-1ab5a63253cd',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.293191] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.293326] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.293405] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.294427] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.294609] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.294721] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e is going to be updated. [ 716.339886] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.339886] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.339886] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.339886] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.340396] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.352755] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e in Status: IN_PROGRESS for 2s [ 716.779200] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.779517] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.779517] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.779737] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.779837] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.779945] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd is going to be created. [ 716.825470] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.825619] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.825707] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.825923] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.826109] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.843092] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd in Status: UNINITIALIZED for 2s [ 717.524049] env[62842]: INFO networking_nsxv3.common.synchronization [req-263945b0-5269-46b0-b0be-646724730d57 req-156a75c8-58fc-40da-95e0-9b776d2607f8 service nova] Enqueued Resource ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e with Priority: HIGHEST for action security_group_rules [ 717.524049] env[62842]: INFO networking_nsxv3.common.synchronization [req-263945b0-5269-46b0-b0be-646724730d57 req-156a75c8-58fc-40da-95e0-9b776d2607f8 service nova] Enqueued Resource ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e with Priority: HIGHEST for action security_group_members [ 717.524049] env[62842]: INFO networking_nsxv3.common.synchronization [req-263945b0-5269-46b0-b0be-646724730d57 req-156a75c8-58fc-40da-95e0-9b776d2607f8 service nova] Enqueued Resource ID: 58006e23-f2a3-4f65-bc77-566d880ffbe6 with Priority: HIGHEST for action port [ 717.524049] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e with Priority: HIGHEST for action security_group_rules [ 717.524049] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e with Priority: HIGHEST for action security_group_members [ 717.524049] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58006e23-f2a3-4f65-bc77-566d880ffbe6 with Priority: HIGHEST for action port [ 717.525415] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.525415] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.527564] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.527564] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.527564] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7acb0f4-6157-4a0c-977e-ee6a2808aa0e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.527564] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.528415] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.528737] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-58006e23-f2a3-4f65-bc77-566d880ffbe6 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.528995] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-58006e23-f2a3-4f65-bc77-566d880ffbe6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.533548] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-58006e23-f2a3-4f65-bc77-566d880ffbe6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.533548] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-58006e23-f2a3-4f65-bc77-566d880ffbe6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.533548] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58006e23-f2a3-4f65-bc77-566d880ffbe6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.581679] env[62842]: INFO networking_nsxv3.common.synchronization [req-07da88d0-b6aa-4252-8e35-7e6a6ecfa229 req-159e9560-4c02-4b7f-a0fd-61e71ee175cb tempest-ServerActionsTestOtherA-1611322165 tempest-ServerActionsTestOtherA-1611322165-project-member] Enqueued Resource ID: a28c97db-60c3-43e3-8413-1620ac6f1f6d with Priority: HIGHEST for action security_group_members [ 717.582651] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a28c97db-60c3-43e3-8413-1620ac6f1f6d with Priority: HIGHEST for action security_group_members [ 717.582889] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-a28c97db-60c3-43e3-8413-1620ac6f1f6d taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.585890] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a28c97db-60c3-43e3-8413-1620ac6f1f6d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.585997] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a28c97db-60c3-43e3-8413-1620ac6f1f6d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.586299] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a28c97db-60c3-43e3-8413-1620ac6f1f6d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.586478] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.586586] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.586649] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.586799] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.586881] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.586976] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a28c97db-60c3-43e3-8413-1620ac6f1f6d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.038327] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.038327] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.044115] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 58006e23-f2a3-4f65-bc77-566d880ffbe6 with status ACTIVE [ 718.044115] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.044115] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.044115] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.044115] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.044115] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.044115] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.044115] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.044115] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.044115] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.044115] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.044115] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.044115] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.044115] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.044115] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.044115] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.044738] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 58006e23-f2a3-4f65-bc77-566d880ffbe6 is going to be updated. [ 718.068879] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.069059] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.069140] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.069355] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.069487] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.069651] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-58006e23-f2a3-4f65-bc77-566d880ffbe6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.090085] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.090268] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.090343] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.090561] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.090657] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.090851] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.090947] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.091015] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.091162] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.091240] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.091339] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a28c97db-60c3-43e3-8413-1620ac6f1f6d already deleted. [ 718.091401] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a28c97db-60c3-43e3-8413-1620ac6f1f6d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.158746] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-8 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.158746] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.158746] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.159050] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.159308] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.159470] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.159586] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.159801] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.159944] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.160220] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 718.160331] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 718.160467] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 718.160541] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 718.160645] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 718.160743] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 718.160876] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 718.193424] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 718.193616] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 718.193754] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 718.193975] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.194457] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-76049061-0317-425d-9508-38ec8bc9e9de taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.194692] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-76049061-0317-425d-9508-38ec8bc9e9de" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.194864] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-76049061-0317-425d-9508-38ec8bc9e9de" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.196435] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-76049061-0317-425d-9508-38ec8bc9e9de" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.196435] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76049061-0317-425d-9508-38ec8bc9e9de',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.363413] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e in Status: SUCCESS [ 718.363413] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.363413] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.363413] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.363574] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.363690] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.363957] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.364069] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.364105] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.364173] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7acb0f4-6157-4a0c-977e-ee6a2808aa0e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.701069] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.701069] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.701069] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.701338] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.701404] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.701559] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 76049061-0317-425d-9508-38ec8bc9e9de not found, creating... [ 718.701818] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.701977] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.702141] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.702343] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.702481] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.702803] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.702976] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.703107] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.703315] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.703524] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.703609] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 76049061-0317-425d-9508-38ec8bc9e9de is going to be created. [ 718.723933] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.724184] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.724277] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.724563] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.724833] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.725031] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-76049061-0317-425d-9508-38ec8bc9e9de" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.869916] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e7acb0f4-6157-4a0c-977e-ee6a2808aa0e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.885106] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd in Status: SUCCESS [ 718.885349] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.885533] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.885754] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.885952] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.886086] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.886159] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.886315] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.886409] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.886476] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.886570] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('82e532f4-b8b0-4a4a-affc-1ab5a63253cd',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.378282] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e7acb0f4-6157-4a0c-977e-ee6a2808aa0e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.391857] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.392311] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.392311] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.392476] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.392537] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.392652] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.392845] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.392845] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.392988] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.393049] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.393173] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.393277] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.393328] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.393471] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.393614] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.393700] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.393750] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.393887] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.393968] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.394071] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.394166] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('82e532f4-b8b0-4a4a-affc-1ab5a63253cd',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.565667] env[62842]: INFO networking_nsxv3.common.synchronization [req-07da88d0-b6aa-4252-8e35-7e6a6ecfa229 req-a5871de1-2d64-42ed-be4c-610f089b440b service nova] Enqueued Resource ID: a28c97db-60c3-43e3-8413-1620ac6f1f6d with Priority: HIGHEST for action security_group_rules [ 719.568264] env[62842]: INFO networking_nsxv3.common.synchronization [req-07da88d0-b6aa-4252-8e35-7e6a6ecfa229 req-a5871de1-2d64-42ed-be4c-610f089b440b service nova] Enqueued Resource ID: a28c97db-60c3-43e3-8413-1620ac6f1f6d with Priority: HIGHEST for action security_group_members [ 719.568264] env[62842]: INFO networking_nsxv3.common.synchronization [req-07da88d0-b6aa-4252-8e35-7e6a6ecfa229 req-a5871de1-2d64-42ed-be4c-610f089b440b service nova] Enqueued Resource ID: 76049061-0317-425d-9508-38ec8bc9e9de with Priority: HIGHEST for action port [ 719.568264] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a28c97db-60c3-43e3-8413-1620ac6f1f6d with Priority: HIGHEST for action security_group_rules [ 719.568563] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a28c97db-60c3-43e3-8413-1620ac6f1f6d with Priority: HIGHEST for action security_group_members [ 719.568563] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76049061-0317-425d-9508-38ec8bc9e9de with Priority: HIGHEST for action port [ 719.568751] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a28c97db-60c3-43e3-8413-1620ac6f1f6d taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.568891] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a28c97db-60c3-43e3-8413-1620ac6f1f6d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.568961] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a28c97db-60c3-43e3-8413-1620ac6f1f6d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.569273] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a28c97db-60c3-43e3-8413-1620ac6f1f6d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.569360] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a28c97db-60c3-43e3-8413-1620ac6f1f6d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.570540] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-a28c97db-60c3-43e3-8413-1620ac6f1f6d taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.570540] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a28c97db-60c3-43e3-8413-1620ac6f1f6d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.570540] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a28c97db-60c3-43e3-8413-1620ac6f1f6d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.570730] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a28c97db-60c3-43e3-8413-1620ac6f1f6d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.570907] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.571016] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.571084] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.571580] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.571702] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.571815] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a28c97db-60c3-43e3-8413-1620ac6f1f6d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.572757] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-76049061-0317-425d-9508-38ec8bc9e9de taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.572913] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-76049061-0317-425d-9508-38ec8bc9e9de" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.572994] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-76049061-0317-425d-9508-38ec8bc9e9de" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.573209] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-76049061-0317-425d-9508-38ec8bc9e9de" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.573293] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76049061-0317-425d-9508-38ec8bc9e9de',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.881280] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.882936] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.882936] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.883109] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.883352] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.883531] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e is going to be updated. [ 719.896924] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 82e532f4-b8b0-4a4a-affc-1ab5a63253cd: rpc.has_security_group_logging(os_id): False [ 719.919110] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.919341] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.919341] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.919522] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.919664] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.921790] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.921966] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.921966] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.922290] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.922344] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.922498] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.922591] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.922645] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.922791] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.922863] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.923082] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.923205] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.923261] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.923379] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.923450] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.924147] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.924276] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.924345] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.924493] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.924563] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.924650] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd is going to be created. [ 719.928802] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e in Status: IN_PROGRESS for 2s [ 719.979486] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.979629] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.979700] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.979917] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.980158] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.994576] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd in Status: IN_PROGRESS for 2s [ 720.077381] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a28c97db-60c3-43e3-8413-1620ac6f1f6d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.078463] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-a28c97db-60c3-43e3-8413-1620ac6f1f6d taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.078584] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a28c97db-60c3-43e3-8413-1620ac6f1f6d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.079152] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 76049061-0317-425d-9508-38ec8bc9e9de with status ACTIVE [ 720.079152] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.079272] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.079272] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.079471] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.079587] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.079723] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.079815] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.079875] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.080340] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.080599] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.080710] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.080809] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.080868] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.081022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.081102] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.081193] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 76049061-0317-425d-9508-38ec8bc9e9de is going to be updated. [ 720.127551] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.127726] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.127770] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.127944] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.128135] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.128332] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-76049061-0317-425d-9508-38ec8bc9e9de" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.251961] env[62842]: INFO networking_nsxv3.common.synchronization [req-f0e36f5a-4ca4-47eb-90b9-eb0d7649e0f0 req-5518f42d-7f6d-4cad-b260-e88c39796f31 tempest-MigrationsAdminTest-2116750055 tempest-MigrationsAdminTest-2116750055-project-member] Enqueued Resource ID: 38b4d382-6400-4588-b620-faecfba1fd64 with Priority: HIGHEST for action security_group_members [ 720.253137] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38b4d382-6400-4588-b620-faecfba1fd64 with Priority: HIGHEST for action security_group_members [ 720.253511] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-38b4d382-6400-4588-b620-faecfba1fd64 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.253640] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.253706] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.254101] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.254101] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.254227] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.254227] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.255031] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.255031] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.255031] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38b4d382-6400-4588-b620-faecfba1fd64',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.579534] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a28c97db-60c3-43e3-8413-1620ac6f1f6d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.757552] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('38b4d382-6400-4588-b620-faecfba1fd64',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.909365] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-938 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.909365] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-938" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.909365] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-938" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.909866] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-938" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.909866] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.909947] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.910131] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.910363] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.910507] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.910908] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 720.910908] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 720.910908] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 720.911024] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 720.912601] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 720.915360] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 720.915360] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 720.946042] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 720.946042] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 720.946042] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 720.946042] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-938" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.946042] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-35406f87-5073-49f4-8677-88e3575f78c2 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.946042] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-35406f87-5073-49f4-8677-88e3575f78c2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.946890] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-35406f87-5073-49f4-8677-88e3575f78c2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.947683] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-35406f87-5073-49f4-8677-88e3575f78c2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.948037] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35406f87-5073-49f4-8677-88e3575f78c2',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.082962] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.083136] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.083285] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.083625] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.083914] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.084036] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a28c97db-60c3-43e3-8413-1620ac6f1f6d is going to be created. [ 721.112472] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.112578] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.113611] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.113611] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.113611] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.124243] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a28c97db-60c3-43e3-8413-1620ac6f1f6d in Status: UNINITIALIZED for 2s [ 721.259015] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('38b4d382-6400-4588-b620-faecfba1fd64',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.453663] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.453784] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.453824] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.454131] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.454291] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.456418] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 35406f87-5073-49f4-8677-88e3575f78c2 not found, creating... [ 721.456418] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.456418] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.456418] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.456418] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.456418] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.456418] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.456418] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.456418] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.456818] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.456818] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.456889] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 35406f87-5073-49f4-8677-88e3575f78c2 is going to be created. [ 721.481419] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.481663] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.481788] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.482071] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.482528] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.482528] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-35406f87-5073-49f4-8677-88e3575f78c2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.767280] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.767693] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.767693] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.767693] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.767828] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.767828] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38b4d382-6400-4588-b620-faecfba1fd64 is going to be updated. [ 721.810815] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.811072] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.811072] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.811248] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.811601] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.825970] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38b4d382-6400-4588-b620-faecfba1fd64 in Status: IN_PROGRESS for 2s [ 721.941987] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e in Status: SUCCESS [ 721.942332] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.942579] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.942885] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.943192] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.943368] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.943557] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.944801] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.945065] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.945510] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.945873] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e7acb0f4-6157-4a0c-977e-ee6a2808aa0e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.009833] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd in Status: SUCCESS [ 722.010088] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.449077] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.449241] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.449311] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.450136] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.450370] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.450538] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.454161] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.454161] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.454161] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.454161] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.454161] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.454161] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.454161] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.454161] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.454161] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.454161] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.454161] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.454161] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.454161] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.454161] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.454161] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e7acb0f4-6157-4a0c-977e-ee6a2808aa0e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.629395] env[62842]: INFO networking_nsxv3.common.synchronization [req-f0e36f5a-4ca4-47eb-90b9-eb0d7649e0f0 req-b44f6256-46fe-4be5-b7c9-9a3efeca8c7e service nova] Enqueued Resource ID: 38b4d382-6400-4588-b620-faecfba1fd64 with Priority: HIGHEST for action security_group_rules [ 722.629395] env[62842]: INFO networking_nsxv3.common.synchronization [req-f0e36f5a-4ca4-47eb-90b9-eb0d7649e0f0 req-b44f6256-46fe-4be5-b7c9-9a3efeca8c7e service nova] Enqueued Resource ID: 38b4d382-6400-4588-b620-faecfba1fd64 with Priority: HIGHEST for action security_group_members [ 722.629395] env[62842]: INFO networking_nsxv3.common.synchronization [req-f0e36f5a-4ca4-47eb-90b9-eb0d7649e0f0 req-b44f6256-46fe-4be5-b7c9-9a3efeca8c7e service nova] Enqueued Resource ID: 35406f87-5073-49f4-8677-88e3575f78c2 with Priority: HIGHEST for action port [ 722.629395] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38b4d382-6400-4588-b620-faecfba1fd64 with Priority: HIGHEST for action security_group_rules [ 722.629395] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38b4d382-6400-4588-b620-faecfba1fd64 with Priority: HIGHEST for action security_group_members [ 722.629395] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35406f87-5073-49f4-8677-88e3575f78c2 with Priority: HIGHEST for action port [ 722.629395] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-38b4d382-6400-4588-b620-faecfba1fd64 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.629871] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.630089] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.630513] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.630693] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('38b4d382-6400-4588-b620-faecfba1fd64',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.632268] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-38b4d382-6400-4588-b620-faecfba1fd64 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.632562] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.634074] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-35406f87-5073-49f4-8677-88e3575f78c2 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.634324] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-35406f87-5073-49f4-8677-88e3575f78c2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.634475] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-35406f87-5073-49f4-8677-88e3575f78c2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.634933] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-35406f87-5073-49f4-8677-88e3575f78c2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.635102] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35406f87-5073-49f4-8677-88e3575f78c2',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.957071] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e7acb0f4-6157-4a0c-977e-ee6a2808aa0e: rpc.has_security_group_logging(os_id): False [ 722.979351] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.979351] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.979351] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.979351] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.013393] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.013695] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.013860] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.013914] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.014101] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.014189] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.014437] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.014561] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.014626] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.014903] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.014903] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.015093] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.015224] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.015314] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.015503] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.015598] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.015689] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e is going to be updated. [ 723.110093] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.110356] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.110488] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.110699] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.110923] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.129946] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e in Status: IN_PROGRESS for 2s [ 723.134865] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a28c97db-60c3-43e3-8413-1620ac6f1f6d in Status: SUCCESS [ 723.134865] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a28c97db-60c3-43e3-8413-1620ac6f1f6d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.134865] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a28c97db-60c3-43e3-8413-1620ac6f1f6d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.135072] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a28c97db-60c3-43e3-8413-1620ac6f1f6d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.135330] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.135509] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.135551] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.135958] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.136096] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.136212] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a28c97db-60c3-43e3-8413-1620ac6f1f6d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.136336] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a28c97db-60c3-43e3-8413-1620ac6f1f6d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.137579] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-38b4d382-6400-4588-b620-faecfba1fd64 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.137716] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.137907] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 35406f87-5073-49f4-8677-88e3575f78c2 with status ACTIVE [ 723.138117] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.138248] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.138321] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.138518] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.139088] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.139458] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.139642] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.139746] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.139974] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.140124] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.140405] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.140599] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.140670] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.140937] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.140937] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.141088] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 35406f87-5073-49f4-8677-88e3575f78c2 is going to be updated. [ 723.166349] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.166611] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.166683] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.166906] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.168661] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.168661] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-35406f87-5073-49f4-8677-88e3575f78c2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.643645] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-a28c97db-60c3-43e3-8413-1620ac6f1f6d taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.643832] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a28c97db-60c3-43e3-8413-1620ac6f1f6d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.643953] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a28c97db-60c3-43e3-8413-1620ac6f1f6d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.644151] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a28c97db-60c3-43e3-8413-1620ac6f1f6d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.644334] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.644441] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.644569] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.644733] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.644873] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.645037] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a28c97db-60c3-43e3-8413-1620ac6f1f6d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.645195] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-a28c97db-60c3-43e3-8413-1620ac6f1f6d taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.645304] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a28c97db-60c3-43e3-8413-1620ac6f1f6d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.645422] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a28c97db-60c3-43e3-8413-1620ac6f1f6d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.645499] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a28c97db-60c3-43e3-8413-1620ac6f1f6d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.645616] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.645726] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.645828] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.645911] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.645961] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.646383] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a28c97db-60c3-43e3-8413-1620ac6f1f6d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.646513] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a28c97db-60c3-43e3-8413-1620ac6f1f6d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.839412] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38b4d382-6400-4588-b620-faecfba1fd64 in Status: SUCCESS [ 723.839674] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.839860] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.840169] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.841391] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.841551] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.841658] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.841883] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.841980] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.842109] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38b4d382-6400-4588-b620-faecfba1fd64',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.152365] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a28c97db-60c3-43e3-8413-1620ac6f1f6d: rpc.has_security_group_logging(os_id): False [ 724.173748] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.173997] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.174090] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.174787] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.174787] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.174787] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.174787] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.174787] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.175019] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.175019] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.175312] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.175421] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.175475] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.175633] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.175710] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.175910] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.176015] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.176112] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.176300] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.176381] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.176476] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a28c97db-60c3-43e3-8413-1620ac6f1f6d is going to be created. [ 724.264771] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.264771] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.264771] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.264771] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.265093] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.285295] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a28c97db-60c3-43e3-8413-1620ac6f1f6d in Status: IN_PROGRESS for 2s [ 724.349471] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('38b4d382-6400-4588-b620-faecfba1fd64',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.360391] env[62842]: INFO networking_nsxv3.common.synchronization [None req-2c1a7bd9-8051-4dbd-a0db-969299be724d None None] Enqueued Resource ID: 8180ebd4-b03a-4e08-8ade-0a3edf1d6edf with Priority: HIGHEST for action port [ 724.361273] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8180ebd4-b03a-4e08-8ade-0a3edf1d6edf with Priority: HIGHEST for action port [ 724.361693] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-8180ebd4-b03a-4e08-8ade-0a3edf1d6edf taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.361793] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8180ebd4-b03a-4e08-8ade-0a3edf1d6edf" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.361867] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8180ebd4-b03a-4e08-8ade-0a3edf1d6edf" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.365514] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8180ebd4-b03a-4e08-8ade-0a3edf1d6edf" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.365514] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8180ebd4-b03a-4e08-8ade-0a3edf1d6edf',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.853714] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('38b4d382-6400-4588-b620-faecfba1fd64',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.866042] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8180ebd4-b03a-4e08-8ade-0a3edf1d6edf [ 724.866042] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.866042] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.866042] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.866042] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.866042] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.866042] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8180ebd4-b03a-4e08-8ade-0a3edf1d6edf already deleted. [ 724.866042] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8180ebd4-b03a-4e08-8ade-0a3edf1d6edf" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.035343] env[62842]: INFO networking_nsxv3.common.synchronization [req-f7df1faa-a82c-4ea6-8f6f-d47830484789 req-254507e8-50ab-48ce-aab7-ed355fa50e31 tempest-ServerAddressesNegativeTestJSON-348899282 tempest-ServerAddressesNegativeTestJSON-348899282-project-member] Enqueued Resource ID: 72454528-d410-48ed-92f0-27b44c9abb61 with Priority: HIGHEST for action security_group_members [ 725.035936] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72454528-d410-48ed-92f0-27b44c9abb61 with Priority: HIGHEST for action security_group_members [ 725.036278] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-72454528-d410-48ed-92f0-27b44c9abb61 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.036401] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72454528-d410-48ed-92f0-27b44c9abb61" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.036465] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72454528-d410-48ed-92f0-27b44c9abb61" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.038604] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72454528-d410-48ed-92f0-27b44c9abb61" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.039277] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.039277] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.039277] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.039277] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.039277] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.039497] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72454528-d410-48ed-92f0-27b44c9abb61',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.164387] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e in Status: SUCCESS [ 725.164737] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.357519] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.357696] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.357754] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.358330] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.358330] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.358330] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38b4d382-6400-4588-b620-faecfba1fd64 is going to be updated. [ 725.394075] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.395057] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.395057] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.395057] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.395057] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.407929] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38b4d382-6400-4588-b620-faecfba1fd64 in Status: IN_PROGRESS for 2s [ 725.545964] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.546472] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.546973] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.547461] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.547461] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.548718] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.548718] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.548718] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.549617] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.550555] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.551938] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72454528-d410-48ed-92f0-27b44c9abb61 already deleted. [ 725.552718] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72454528-d410-48ed-92f0-27b44c9abb61" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.606407] env[62842]: INFO networking_nsxv3.common.synchronization [req-6ff387cd-f466-415d-84a8-ce6d69cc9719 req-ab25d8ef-9774-4075-9cbe-826c74bf02ed tempest-SecurityGroupsTestJSON-1354345429 tempest-SecurityGroupsTestJSON-1354345429-project-member] Enqueued Resource ID: 1648554a-7f11-49bf-b9b2-6edf888e2ce9 with Priority: HIGHEST for action security_group_members [ 725.607033] env[62842]: INFO networking_nsxv3.common.synchronization [req-6ff387cd-f466-415d-84a8-ce6d69cc9719 req-ab25d8ef-9774-4075-9cbe-826c74bf02ed tempest-SecurityGroupsTestJSON-1354345429 tempest-SecurityGroupsTestJSON-1354345429-project-member] Enqueued Resource ID: 5704e4e3-8211-4e30-b474-06c668cf060d with Priority: HIGHEST for action security_group_members [ 725.607033] env[62842]: INFO networking_nsxv3.common.synchronization [req-6ff387cd-f466-415d-84a8-ce6d69cc9719 req-ab25d8ef-9774-4075-9cbe-826c74bf02ed tempest-SecurityGroupsTestJSON-1354345429 tempest-SecurityGroupsTestJSON-1354345429-project-member] Enqueued Resource ID: ccb27bcf-56d8-49d9-af51-9eb4b1211bce with Priority: HIGHEST for action security_group_members [ 725.609272] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1648554a-7f11-49bf-b9b2-6edf888e2ce9 with Priority: HIGHEST for action security_group_members [ 725.609272] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5704e4e3-8211-4e30-b474-06c668cf060d with Priority: HIGHEST for action security_group_members [ 725.609425] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccb27bcf-56d8-49d9-af51-9eb4b1211bce with Priority: HIGHEST for action security_group_members [ 725.609596] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-1648554a-7f11-49bf-b9b2-6edf888e2ce9 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.609723] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1648554a-7f11-49bf-b9b2-6edf888e2ce9" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.609787] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1648554a-7f11-49bf-b9b2-6edf888e2ce9" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.609994] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1648554a-7f11-49bf-b9b2-6edf888e2ce9" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.610192] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.610299] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.610378] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.611498] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.611498] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.611498] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1648554a-7f11-49bf-b9b2-6edf888e2ce9',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.611697] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5704e4e3-8211-4e30-b474-06c668cf060d taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.611791] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.611847] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.612036] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.614813] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.614923] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.614979] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.615151] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.615261] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.615365] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5704e4e3-8211-4e30-b474-06c668cf060d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.616729] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccb27bcf-56d8-49d9-af51-9eb4b1211bce taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.616729] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccb27bcf-56d8-49d9-af51-9eb4b1211bce" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.616729] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccb27bcf-56d8-49d9-af51-9eb4b1211bce" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.616729] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccb27bcf-56d8-49d9-af51-9eb4b1211bce" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.616729] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.617022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.617022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.617022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.617133] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.617182] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ccb27bcf-56d8-49d9-af51-9eb4b1211bce',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.783717] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-767 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.783956] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-767" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.785017] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-767" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.785017] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-767" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.785017] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.785017] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.788023] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.788300] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.788453] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.788664] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 725.788777] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 725.788885] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 725.788993] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 725.789165] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 725.789281] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 725.789529] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 725.810058] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 725.810250] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 725.810415] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 725.810604] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-767" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.810937] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-d7cdac99-eb8b-46b0-92f8-2c2fea7c116d taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.811126] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-d7cdac99-eb8b-46b0-92f8-2c2fea7c116d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.811251] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-d7cdac99-eb8b-46b0-92f8-2c2fea7c116d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.811614] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-d7cdac99-eb8b-46b0-92f8-2c2fea7c116d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.811759] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7cdac99-eb8b-46b0-92f8-2c2fea7c116d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.118988] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.119209] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.119287] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.119691] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.119691] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.119878] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.120017] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.120076] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.120266] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.120356] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.120466] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5704e4e3-8211-4e30-b474-06c668cf060d is going to be updated. [ 726.121725] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.121954] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.121954] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.123733] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.125913] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.126070] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.150168] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.150458] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.150586] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.150651] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.150847] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.150928] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.151025] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1648554a-7f11-49bf-b9b2-6edf888e2ce9 is going to be updated. [ 726.152815] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.153069] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.160482] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.161014] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.161154] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.161418] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.161615] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.171581] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5704e4e3-8211-4e30-b474-06c668cf060d in Status: IN_PROGRESS for 2s [ 726.179258] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.179465] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.179601] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.179656] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.179893] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.179987] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.180095] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ccb27bcf-56d8-49d9-af51-9eb4b1211bce is going to be updated. [ 726.185659] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.186410] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.186410] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.186410] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.186410] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.200856] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1648554a-7f11-49bf-b9b2-6edf888e2ce9 in Status: IN_PROGRESS for 2s [ 726.213358] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.213645] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.213645] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.213831] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.213973] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.224984] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccb27bcf-56d8-49d9-af51-9eb4b1211bce in Status: IN_PROGRESS for 2s [ 726.301883] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a28c97db-60c3-43e3-8413-1620ac6f1f6d in Status: SUCCESS [ 726.302125] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a28c97db-60c3-43e3-8413-1620ac6f1f6d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.316551] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.316806] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.316906] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.317518] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.317730] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.317806] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port d7cdac99-eb8b-46b0-92f8-2c2fea7c116d not found, creating... [ 726.318253] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.318391] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.318391] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.318651] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.318790] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.319827] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.319936] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.320028] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.321213] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.321213] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.321213] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: d7cdac99-eb8b-46b0-92f8-2c2fea7c116d is going to be created. [ 726.351821] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.351821] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.351821] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.351821] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.351821] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.351821] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-d7cdac99-eb8b-46b0-92f8-2c2fea7c116d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.993047] env[62842]: INFO networking_nsxv3.common.synchronization [None req-889a280a-3c46-47b5-9d0c-4f8de7d428d5 None None] Enqueued Resource ID: 34ab3748-802a-43c9-8a26-5c1592f62174 with Priority: HIGHEST for action port [ 726.993658] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34ab3748-802a-43c9-8a26-5c1592f62174 with Priority: HIGHEST for action port [ 726.993959] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-34ab3748-802a-43c9-8a26-5c1592f62174 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.995091] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-34ab3748-802a-43c9-8a26-5c1592f62174" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.995171] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-34ab3748-802a-43c9-8a26-5c1592f62174" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.995451] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-34ab3748-802a-43c9-8a26-5c1592f62174" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.995540] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34ab3748-802a-43c9-8a26-5c1592f62174',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.421972] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38b4d382-6400-4588-b620-faecfba1fd64 in Status: SUCCESS [ 727.422320] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.422502] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.422783] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.423047] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.423227] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.423327] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.423526] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.423651] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.423776] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.423904] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('38b4d382-6400-4588-b620-faecfba1fd64',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.499218] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 34ab3748-802a-43c9-8a26-5c1592f62174 [ 727.499657] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.499657] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.499855] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.499915] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.499980] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.500115] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:34ab3748-802a-43c9-8a26-5c1592f62174 already deleted. [ 727.500284] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-34ab3748-802a-43c9-8a26-5c1592f62174" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.516624] env[62842]: INFO networking_nsxv3.common.synchronization [req-f7df1faa-a82c-4ea6-8f6f-d47830484789 req-1019b9c1-0089-4e08-b140-e99cbc00e5fb service nova] Enqueued Resource ID: 72454528-d410-48ed-92f0-27b44c9abb61 with Priority: HIGHEST for action security_group_rules [ 727.517409] env[62842]: INFO networking_nsxv3.common.synchronization [req-f7df1faa-a82c-4ea6-8f6f-d47830484789 req-1019b9c1-0089-4e08-b140-e99cbc00e5fb service nova] Enqueued Resource ID: 72454528-d410-48ed-92f0-27b44c9abb61 with Priority: HIGHEST for action security_group_members [ 727.517409] env[62842]: INFO networking_nsxv3.common.synchronization [req-f7df1faa-a82c-4ea6-8f6f-d47830484789 req-1019b9c1-0089-4e08-b140-e99cbc00e5fb service nova] Enqueued Resource ID: d7cdac99-eb8b-46b0-92f8-2c2fea7c116d with Priority: HIGHEST for action port [ 727.517522] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72454528-d410-48ed-92f0-27b44c9abb61 with Priority: HIGHEST for action security_group_rules [ 727.517605] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72454528-d410-48ed-92f0-27b44c9abb61 with Priority: HIGHEST for action security_group_members [ 727.517746] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7cdac99-eb8b-46b0-92f8-2c2fea7c116d with Priority: HIGHEST for action port [ 727.517951] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72454528-d410-48ed-92f0-27b44c9abb61 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.521098] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72454528-d410-48ed-92f0-27b44c9abb61" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.521098] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72454528-d410-48ed-92f0-27b44c9abb61" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.521098] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72454528-d410-48ed-92f0-27b44c9abb61" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.521098] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72454528-d410-48ed-92f0-27b44c9abb61',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.521336] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-72454528-d410-48ed-92f0-27b44c9abb61 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.521446] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72454528-d410-48ed-92f0-27b44c9abb61" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.521509] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72454528-d410-48ed-92f0-27b44c9abb61" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.521685] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72454528-d410-48ed-92f0-27b44c9abb61" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.521829] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.521918] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.521984] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.522167] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.522249] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.522338] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72454528-d410-48ed-92f0-27b44c9abb61',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.523083] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7cdac99-eb8b-46b0-92f8-2c2fea7c116d taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.523183] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7cdac99-eb8b-46b0-92f8-2c2fea7c116d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.523242] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7cdac99-eb8b-46b0-92f8-2c2fea7c116d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.523384] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7cdac99-eb8b-46b0-92f8-2c2fea7c116d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.523451] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7cdac99-eb8b-46b0-92f8-2c2fea7c116d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.642668] env[62842]: INFO networking_nsxv3.common.synchronization [None req-d564be02-8f6d-41f4-9b84-2c94aecb13cf None None] Enqueued Resource ID: 84329da9-df28-402a-bea5-10de5b99cf8e with Priority: HIGHEST for action port [ 727.642785] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84329da9-df28-402a-bea5-10de5b99cf8e with Priority: HIGHEST for action port [ 727.643403] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-84329da9-df28-402a-bea5-10de5b99cf8e taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.643502] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-84329da9-df28-402a-bea5-10de5b99cf8e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.643596] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-84329da9-df28-402a-bea5-10de5b99cf8e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.643902] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-84329da9-df28-402a-bea5-10de5b99cf8e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.643978] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84329da9-df28-402a-bea5-10de5b99cf8e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.926946] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-38b4d382-6400-4588-b620-faecfba1fd64 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.927285] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.927285] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.927582] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.931404] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.931630] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.931689] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.931942] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.932076] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.932209] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.932413] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-38b4d382-6400-4588-b620-faecfba1fd64 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.932560] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.932560] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.932822] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.933235] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.933548] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.933627] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.933919] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.934097] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.934294] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.934745] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('38b4d382-6400-4588-b620-faecfba1fd64',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.025508] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-72454528-d410-48ed-92f0-27b44c9abb61 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.025688] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72454528-d410-48ed-92f0-27b44c9abb61" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.030562] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('72454528-d410-48ed-92f0-27b44c9abb61',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.032595] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d7cdac99-eb8b-46b0-92f8-2c2fea7c116d with status ACTIVE [ 728.032996] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.033285] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.033416] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.033787] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.033970] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.038687] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.038926] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.039119] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.039448] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.039646] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.040082] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.040256] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.040320] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.043676] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.043919] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.044147] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d7cdac99-eb8b-46b0-92f8-2c2fea7c116d is going to be updated. [ 728.049545] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('72454528-d410-48ed-92f0-27b44c9abb61',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.085392] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.085619] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.085745] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.086139] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.086375] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.086606] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7cdac99-eb8b-46b0-92f8-2c2fea7c116d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.147018] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 84329da9-df28-402a-bea5-10de5b99cf8e [ 728.147618] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.147618] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.147618] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.147825] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.147825] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.147913] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:84329da9-df28-402a-bea5-10de5b99cf8e already deleted. [ 728.147943] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-84329da9-df28-402a-bea5-10de5b99cf8e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.182456] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5704e4e3-8211-4e30-b474-06c668cf060d in Status: SUCCESS [ 728.182691] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5704e4e3-8211-4e30-b474-06c668cf060d deletion is rescheduled due to dependency. [ 728.182828] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5704e4e3-8211-4e30-b474-06c668cf060d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.215180] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1648554a-7f11-49bf-b9b2-6edf888e2ce9 in Status: SUCCESS [ 728.215610] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1648554a-7f11-49bf-b9b2-6edf888e2ce9 deletion is rescheduled due to dependency. [ 728.215735] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1648554a-7f11-49bf-b9b2-6edf888e2ce9" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.238017] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccb27bcf-56d8-49d9-af51-9eb4b1211bce in Status: SUCCESS [ 728.238366] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ccb27bcf-56d8-49d9-af51-9eb4b1211bce deletion is rescheduled due to dependency. [ 728.238542] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccb27bcf-56d8-49d9-af51-9eb4b1211bce" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.437158] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 38b4d382-6400-4588-b620-faecfba1fd64: rpc.has_security_group_logging(os_id): False [ 728.458279] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.458443] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.458443] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.458633] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.483061] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.486093] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.486313] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.486387] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.486634] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.486746] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.487024] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.487251] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.487291] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.487447] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.487525] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.487712] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.487809] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.487870] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.488062] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.488151] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.488243] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 38b4d382-6400-4588-b620-faecfba1fd64 is going to be updated. [ 728.552839] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.552839] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.552839] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.552839] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.552839] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.552839] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72454528-d410-48ed-92f0-27b44c9abb61 is going to be created. [ 728.583411] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.583519] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.583602] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.583796] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.583951] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.587770] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.587770] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.587770] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.589023] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.589023] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.616059] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72454528-d410-48ed-92f0-27b44c9abb61 in Status: UNINITIALIZED for 2s [ 728.621039] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 38b4d382-6400-4588-b620-faecfba1fd64 in Status: IN_PROGRESS for 2s [ 730.527340] env[62842]: INFO networking_nsxv3.common.synchronization [None req-59ff8b82-eb98-4fa7-90ff-8a9fb3df62e3 None None] Enqueued Resource ID: b1224169-2551-47cd-a150-f3d385134c02 with Priority: HIGHEST for action port [ 730.527340] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1224169-2551-47cd-a150-f3d385134c02 with Priority: HIGHEST for action port [ 730.527340] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-b1224169-2551-47cd-a150-f3d385134c02 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.527340] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b1224169-2551-47cd-a150-f3d385134c02" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.527340] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b1224169-2551-47cd-a150-f3d385134c02" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.527340] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b1224169-2551-47cd-a150-f3d385134c02" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.527340] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1224169-2551-47cd-a150-f3d385134c02',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.630785] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72454528-d410-48ed-92f0-27b44c9abb61 in Status: SUCCESS [ 730.631379] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72454528-d410-48ed-92f0-27b44c9abb61" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.631716] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72454528-d410-48ed-92f0-27b44c9abb61" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.632091] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72454528-d410-48ed-92f0-27b44c9abb61" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.633647] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.633647] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.633647] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.633647] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.633647] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.633647] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72454528-d410-48ed-92f0-27b44c9abb61" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.633647] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('72454528-d410-48ed-92f0-27b44c9abb61',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.636654] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 38b4d382-6400-4588-b620-faecfba1fd64 in Status: SUCCESS [ 730.638270] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.029262] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b1224169-2551-47cd-a150-f3d385134c02 [ 731.029262] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.029262] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.029262] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.029453] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.029515] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.030125] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b1224169-2551-47cd-a150-f3d385134c02 already deleted. [ 731.030125] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b1224169-2551-47cd-a150-f3d385134c02" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.136811] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-72454528-d410-48ed-92f0-27b44c9abb61 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.137093] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72454528-d410-48ed-92f0-27b44c9abb61" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.137093] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72454528-d410-48ed-92f0-27b44c9abb61" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.137468] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72454528-d410-48ed-92f0-27b44c9abb61" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.138041] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.138864] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.138864] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.138972] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.139025] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.139703] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72454528-d410-48ed-92f0-27b44c9abb61" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.139703] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-72454528-d410-48ed-92f0-27b44c9abb61 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.139843] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72454528-d410-48ed-92f0-27b44c9abb61" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.139892] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72454528-d410-48ed-92f0-27b44c9abb61" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.140892] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72454528-d410-48ed-92f0-27b44c9abb61" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.140892] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.141037] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.141037] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.141938] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.141938] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.141938] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72454528-d410-48ed-92f0-27b44c9abb61" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.141938] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('72454528-d410-48ed-92f0-27b44c9abb61',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.645256] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 72454528-d410-48ed-92f0-27b44c9abb61: rpc.has_security_group_logging(os_id): False [ 731.666813] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.666813] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.666813] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.666813] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.667252] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.667320] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.667435] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.667511] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.667661] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.667744] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.668304] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.668304] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.668304] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.668304] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.668304] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.668784] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.669587] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.669693] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.669828] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.669909] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.670011] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72454528-d410-48ed-92f0-27b44c9abb61 is going to be created. [ 731.738020] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.738020] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.738020] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.738020] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.738020] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.749544] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72454528-d410-48ed-92f0-27b44c9abb61 in Status: IN_PROGRESS for 2s [ 733.668365] env[62842]: INFO networking_nsxv3.common.synchronization [req-851eb04c-5c46-42f9-82d2-3da9d2681483 req-5bb87d44-8d9c-4e49-b1ea-24ef33388219 tempest-ListServersNegativeTestJSON-2108045219 tempest-ListServersNegativeTestJSON-2108045219-project-member] Enqueued Resource ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 with Priority: HIGHEST for action security_group_members [ 733.669892] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 with Priority: HIGHEST for action security_group_members [ 733.670621] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a595937-aa58-40f8-a3cf-b57a814011e8 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.673353] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.673353] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.673353] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.673353] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.673353] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.673353] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.673353] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.673353] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.673353] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a595937-aa58-40f8-a3cf-b57a814011e8',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.767774] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 72454528-d410-48ed-92f0-27b44c9abb61 in Status: SUCCESS [ 733.768016] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72454528-d410-48ed-92f0-27b44c9abb61" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.940402] env[62842]: INFO networking_nsxv3.common.synchronization [req-5f6e459f-4481-4781-8e04-8b71654b5189 req-81856b3b-9362-4bdf-b0b1-b78e83136a42 tempest-ListServersNegativeTestJSON-2108045219 tempest-ListServersNegativeTestJSON-2108045219-project-member] Enqueued Resource ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 with Priority: HIGHEST for action security_group_members [ 733.941224] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 with Priority: HIGHEST for action security_group_members [ 733.941581] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a595937-aa58-40f8-a3cf-b57a814011e8 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.941723] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.175740] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3a595937-aa58-40f8-a3cf-b57a814011e8',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.483679] env[62842]: INFO networking_nsxv3.common.synchronization [req-00260e95-4ab5-45b7-8f82-0a8a6659b99e req-5f60f565-7c77-4411-8c76-4269b8f5e608 tempest-AttachVolumeNegativeTest-1420230652 tempest-AttachVolumeNegativeTest-1420230652-project-member] Enqueued Resource ID: 1669144b-ae4c-489e-95db-13be5c3bfb22 with Priority: HIGHEST for action security_group_members [ 734.485707] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1669144b-ae4c-489e-95db-13be5c3bfb22 with Priority: HIGHEST for action security_group_members [ 734.486084] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-1669144b-ae4c-489e-95db-13be5c3bfb22 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.486215] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1669144b-ae4c-489e-95db-13be5c3bfb22" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.486280] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1669144b-ae4c-489e-95db-13be5c3bfb22" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.486558] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1669144b-ae4c-489e-95db-13be5c3bfb22" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.486716] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.486824] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.486879] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.487045] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.487133] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.487234] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1669144b-ae4c-489e-95db-13be5c3bfb22',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.681785] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3a595937-aa58-40f8-a3cf-b57a814011e8',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.980051] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-468 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.980051] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-468" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.980051] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-468" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.980051] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-468" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.980051] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.980491] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.980491] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.980653] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.980801] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.981021] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 734.981142] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 734.981618] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 734.981618] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 734.981618] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 734.981618] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 734.981877] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 734.990487] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.990651] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.990743] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.990879] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.990960] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.991160] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.991271] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.991328] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.993019] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.993019] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.993019] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1669144b-ae4c-489e-95db-13be5c3bfb22 already deleted. [ 734.993019] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1669144b-ae4c-489e-95db-13be5c3bfb22" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.002884] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 735.003073] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 735.003214] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 735.003390] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-468" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.003705] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-b8a12dcd-ac81-4888-860a-78b5b0e32b6b taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.003871] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-b8a12dcd-ac81-4888-860a-78b5b0e32b6b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.003988] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-b8a12dcd-ac81-4888-860a-78b5b0e32b6b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.004352] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-b8a12dcd-ac81-4888-860a-78b5b0e32b6b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.004497] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8a12dcd-ac81-4888-860a-78b5b0e32b6b',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.187359] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.187359] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.187359] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.187359] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.187359] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.187359] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 is going to be updated. [ 735.222118] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.222118] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.222118] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.222118] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.222118] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.231959] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 in Status: IN_PROGRESS for 2s [ 735.442799] env[62842]: INFO networking_nsxv3.common.synchronization [req-ff538e7e-a7c0-4be3-91bf-736362661b6b req-b9c8bc99-6696-4441-9e31-d7976ef228c8 tempest-ListImageFiltersTestJSON-20601446 tempest-ListImageFiltersTestJSON-20601446-project-member] Enqueued Resource ID: fe43e864-555f-4ea5-8841-d2bcacb15ecc with Priority: HIGHEST for action security_group_members [ 735.443391] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe43e864-555f-4ea5-8841-d2bcacb15ecc with Priority: HIGHEST for action security_group_members [ 735.443764] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe43e864-555f-4ea5-8841-d2bcacb15ecc taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.443906] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.443976] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.449181] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.449181] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.449181] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.449181] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.449181] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.449181] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.449181] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe43e864-555f-4ea5-8841-d2bcacb15ecc',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.508072] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.508072] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.508483] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.508566] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.508800] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.509036] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port b8a12dcd-ac81-4888-860a-78b5b0e32b6b not found, creating... [ 735.509408] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.509620] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.509822] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.510207] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.510450] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.510913] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.511227] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.511456] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.511806] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.512013] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.512190] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: b8a12dcd-ac81-4888-860a-78b5b0e32b6b is going to be created. [ 735.536807] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.537087] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.537354] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.537731] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.538048] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.538363] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-b8a12dcd-ac81-4888-860a-78b5b0e32b6b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.955282] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.955567] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.955567] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.955725] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.979639] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.979894] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.980025] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.980092] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.980329] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.980609] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.980609] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe43e864-555f-4ea5-8841-d2bcacb15ecc is going to be updated. [ 736.036880] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.036880] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.036880] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.036880] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.036880] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.047310] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe43e864-555f-4ea5-8841-d2bcacb15ecc in Status: IN_PROGRESS for 2s [ 736.351970] env[62842]: INFO networking_nsxv3.common.synchronization [req-00260e95-4ab5-45b7-8f82-0a8a6659b99e req-c1f7eaa6-60ec-4cbf-852b-13d00b3320d3 service nova] Enqueued Resource ID: 1669144b-ae4c-489e-95db-13be5c3bfb22 with Priority: HIGHEST for action security_group_rules [ 736.352154] env[62842]: INFO networking_nsxv3.common.synchronization [req-00260e95-4ab5-45b7-8f82-0a8a6659b99e req-c1f7eaa6-60ec-4cbf-852b-13d00b3320d3 service nova] Enqueued Resource ID: 1669144b-ae4c-489e-95db-13be5c3bfb22 with Priority: HIGHEST for action security_group_members [ 736.352260] env[62842]: INFO networking_nsxv3.common.synchronization [req-00260e95-4ab5-45b7-8f82-0a8a6659b99e req-c1f7eaa6-60ec-4cbf-852b-13d00b3320d3 service nova] Enqueued Resource ID: b8a12dcd-ac81-4888-860a-78b5b0e32b6b with Priority: HIGHEST for action port [ 736.352485] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1669144b-ae4c-489e-95db-13be5c3bfb22 with Priority: HIGHEST for action security_group_rules [ 736.352615] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1669144b-ae4c-489e-95db-13be5c3bfb22 with Priority: HIGHEST for action security_group_members [ 736.352848] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8a12dcd-ac81-4888-860a-78b5b0e32b6b with Priority: HIGHEST for action port [ 736.353289] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1669144b-ae4c-489e-95db-13be5c3bfb22 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.353409] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1669144b-ae4c-489e-95db-13be5c3bfb22" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.353474] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1669144b-ae4c-489e-95db-13be5c3bfb22" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.353671] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1669144b-ae4c-489e-95db-13be5c3bfb22" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.353752] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1669144b-ae4c-489e-95db-13be5c3bfb22',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.356090] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-1669144b-ae4c-489e-95db-13be5c3bfb22 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.356206] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1669144b-ae4c-489e-95db-13be5c3bfb22" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.356273] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1669144b-ae4c-489e-95db-13be5c3bfb22" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.356449] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1669144b-ae4c-489e-95db-13be5c3bfb22" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.356597] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.356689] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.356749] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.356887] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.356970] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.357085] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1669144b-ae4c-489e-95db-13be5c3bfb22',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.357868] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-b8a12dcd-ac81-4888-860a-78b5b0e32b6b taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.357962] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b8a12dcd-ac81-4888-860a-78b5b0e32b6b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.358258] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b8a12dcd-ac81-4888-860a-78b5b0e32b6b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.358258] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b8a12dcd-ac81-4888-860a-78b5b0e32b6b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.358258] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8a12dcd-ac81-4888-860a-78b5b0e32b6b',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.860538] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-1669144b-ae4c-489e-95db-13be5c3bfb22 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.860740] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1669144b-ae4c-489e-95db-13be5c3bfb22" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.860913] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1669144b-ae4c-489e-95db-13be5c3bfb22',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.861883] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b8a12dcd-ac81-4888-860a-78b5b0e32b6b with status ACTIVE [ 736.862113] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.862269] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.862269] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.862479] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.862572] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.862744] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.862842] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.862896] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.863058] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.863139] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.863317] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.863417] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.863480] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.863615] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.863688] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.863770] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b8a12dcd-ac81-4888-860a-78b5b0e32b6b is going to be updated. [ 736.888719] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.888897] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.888939] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.889140] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.889359] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.889520] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b8a12dcd-ac81-4888-860a-78b5b0e32b6b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.242388] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 in Status: SUCCESS [ 737.242771] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.242817] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.243033] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.243229] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.243373] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.243458] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.243630] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.243717] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.243816] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a595937-aa58-40f8-a3cf-b57a814011e8',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.366860] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1669144b-ae4c-489e-95db-13be5c3bfb22',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.749321] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.749321] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.749321] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.749579] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.749695] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.749909] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.750028] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.750090] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.750359] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.750457] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.750547] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 is going to be updated. [ 737.781094] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.781242] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.781311] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.781559] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.781717] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.807593] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 in Status: IN_PROGRESS for 2s [ 737.870376] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.870535] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.870611] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.870830] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.870926] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.871037] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1669144b-ae4c-489e-95db-13be5c3bfb22 is going to be created. [ 737.899478] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.900442] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.900442] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.900442] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.900442] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.914519] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1669144b-ae4c-489e-95db-13be5c3bfb22 in Status: UNINITIALIZED for 2s [ 737.970194] env[62842]: INFO networking_nsxv3.common.synchronization [req-9be799af-f056-4b39-b0fc-ff5035a0367e req-de20cdb7-2c96-46e5-a886-2e4ef1d4e9ef tempest-DeleteServersTestJSON-1113791748 tempest-DeleteServersTestJSON-1113791748-project-member] Enqueued Resource ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 with Priority: HIGHEST for action security_group_members [ 737.970792] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 with Priority: HIGHEST for action security_group_members [ 737.971228] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-35146777-fd28-4ac7-b454-f7dd3fbb5846 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.971377] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.971447] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.971673] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.971835] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.971942] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.971997] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.972161] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.972248] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.972343] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('35146777-fd28-4ac7-b454-f7dd3fbb5846',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.057218] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe43e864-555f-4ea5-8841-d2bcacb15ecc in Status: SUCCESS [ 738.058028] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe43e864-555f-4ea5-8841-d2bcacb15ecc deletion is rescheduled due to dependency. [ 738.058028] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.455562] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-681 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.456118] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-681" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.456118] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-681" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.456447] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-681" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.456831] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.457221] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.457437] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.457741] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.457936] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.458231] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 738.458340] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 738.458442] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 738.458654] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 738.458712] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 738.458803] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 738.458973] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 738.474839] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.475089] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.475196] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.475480] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.490430] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 738.490677] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 738.490867] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 738.491229] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-681" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.491768] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-0f8121cb-152d-42d4-b572-d847b7bcc349 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.491994] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-0f8121cb-152d-42d4-b572-d847b7bcc349" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.492133] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-0f8121cb-152d-42d4-b572-d847b7bcc349" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.492507] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-0f8121cb-152d-42d4-b572-d847b7bcc349" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.492664] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f8121cb-152d-42d4-b572-d847b7bcc349',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.508631] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.508879] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.508999] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.509119] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.509347] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.509442] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.509571] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 is going to be updated. [ 738.569635] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.569873] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.569873] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.570280] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.570396] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.585334] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 in Status: IN_PROGRESS for 2s [ 738.995699] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.998822] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.998822] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.998822] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.998822] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.998822] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 0f8121cb-152d-42d4-b572-d847b7bcc349 not found, creating... [ 738.998822] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.998822] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.998822] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.998822] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.998822] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.999982] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.999982] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.999982] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.999982] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.999982] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.999982] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 0f8121cb-152d-42d4-b572-d847b7bcc349 is going to be created. [ 739.033115] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.033115] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.033115] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.033115] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.033115] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.033115] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-0f8121cb-152d-42d4-b572-d847b7bcc349" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.819739] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 in Status: SUCCESS [ 739.820150] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 deletion is rescheduled due to dependency. [ 739.820198] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.925659] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1669144b-ae4c-489e-95db-13be5c3bfb22 in Status: SUCCESS [ 739.925967] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1669144b-ae4c-489e-95db-13be5c3bfb22" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.926185] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1669144b-ae4c-489e-95db-13be5c3bfb22" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.926482] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1669144b-ae4c-489e-95db-13be5c3bfb22" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.926762] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.926920] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.927029] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.927250] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.927386] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.927501] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1669144b-ae4c-489e-95db-13be5c3bfb22" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.927620] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1669144b-ae4c-489e-95db-13be5c3bfb22',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.080093] env[62842]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] NSXv3 Agent Agent loop - iteration:0 completed [ 740.080221] env[62842]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] NSXv3 Agent Agent loop - iteration:1 started [ 740.166834] env[62842]: INFO networking_nsxv3.common.synchronization [req-490bda75-ece3-40bf-a00a-45816c7755e0 req-b38cb793-cb02-4b50-8e78-6ca2da4b0df2 tempest-ServerAddressesNegativeTestJSON-348899282 tempest-ServerAddressesNegativeTestJSON-348899282-project-member] Enqueued Resource ID: 72454528-d410-48ed-92f0-27b44c9abb61 with Priority: HIGHEST for action security_group_members [ 740.167505] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72454528-d410-48ed-92f0-27b44c9abb61 with Priority: HIGHEST for action security_group_members [ 740.168454] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-72454528-d410-48ed-92f0-27b44c9abb61 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.168454] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72454528-d410-48ed-92f0-27b44c9abb61" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.168955] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72454528-d410-48ed-92f0-27b44c9abb61" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.169352] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72454528-d410-48ed-92f0-27b44c9abb61" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.169524] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.169633] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.169699] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.169873] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.169963] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.170117] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72454528-d410-48ed-92f0-27b44c9abb61',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.285364] env[62842]: INFO networking_nsxv3.common.synchronization [req-9be799af-f056-4b39-b0fc-ff5035a0367e req-6516bbc4-ab3a-4488-9204-7c69aea71bba service nova] Enqueued Resource ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 with Priority: HIGHEST for action security_group_rules [ 740.285364] env[62842]: INFO networking_nsxv3.common.synchronization [req-9be799af-f056-4b39-b0fc-ff5035a0367e req-6516bbc4-ab3a-4488-9204-7c69aea71bba service nova] Enqueued Resource ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 with Priority: HIGHEST for action security_group_members [ 740.285364] env[62842]: INFO networking_nsxv3.common.synchronization [req-9be799af-f056-4b39-b0fc-ff5035a0367e req-6516bbc4-ab3a-4488-9204-7c69aea71bba service nova] Enqueued Resource ID: 0f8121cb-152d-42d4-b572-d847b7bcc349 with Priority: HIGHEST for action port [ 740.286189] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 with Priority: HIGHEST for action security_group_rules [ 740.286389] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 with Priority: HIGHEST for action security_group_members [ 740.286431] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f8121cb-152d-42d4-b572-d847b7bcc349 with Priority: HIGHEST for action port [ 740.286849] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-35146777-fd28-4ac7-b454-f7dd3fbb5846 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.287049] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.287140] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.287390] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.287487] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('35146777-fd28-4ac7-b454-f7dd3fbb5846',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.288577] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-35146777-fd28-4ac7-b454-f7dd3fbb5846 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.288716] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.288867] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f8121cb-152d-42d4-b572-d847b7bcc349 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.289015] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f8121cb-152d-42d4-b572-d847b7bcc349" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.289097] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f8121cb-152d-42d4-b572-d847b7bcc349" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.289332] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f8121cb-152d-42d4-b572-d847b7bcc349" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.289443] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f8121cb-152d-42d4-b572-d847b7bcc349',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.374770] env[62842]: INFO networking_nsxv3.common.synchronization [req-2390b743-506f-4992-a822-561c6fb6435f req-cea027db-8585-4f12-8f81-28a8272bd3f4 tempest-ImagesOneServerNegativeTestJSON-864549307 tempest-ImagesOneServerNegativeTestJSON-864549307-project-member] Enqueued Resource ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd with Priority: HIGHEST for action security_group_members [ 740.376373] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd with Priority: HIGHEST for action security_group_members [ 740.376373] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.376373] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.378042] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.378042] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.378042] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.378042] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.378042] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.378329] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.378329] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.378387] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('82e532f4-b8b0-4a4a-affc-1ab5a63253cd',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.430407] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1669144b-ae4c-489e-95db-13be5c3bfb22',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.594592] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 in Status: SUCCESS [ 740.594785] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 deletion is rescheduled due to dependency. [ 740.594899] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.595079] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.596098] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.596098] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.596098] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.596098] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.596098] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.596098] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.596098] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('35146777-fd28-4ac7-b454-f7dd3fbb5846',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.675926] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.676070] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.676144] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.676352] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.676448] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.676989] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.676989] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.676989] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.676989] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.676989] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.677206] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72454528-d410-48ed-92f0-27b44c9abb61 is going to be updated. [ 740.706927] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.707125] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.707166] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.707454] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.707595] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.716769] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72454528-d410-48ed-92f0-27b44c9abb61 in Status: IN_PROGRESS for 2s [ 740.793627] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-35146777-fd28-4ac7-b454-f7dd3fbb5846 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.793871] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.794501] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0f8121cb-152d-42d4-b572-d847b7bcc349 with status ACTIVE [ 740.794501] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.794501] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.794501] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.794708] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.794708] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.795027] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.795027] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.795027] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.795289] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.795289] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.795370] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.795454] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.795505] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.795655] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.795728] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.795809] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0f8121cb-152d-42d4-b572-d847b7bcc349 is going to be updated. [ 740.825686] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.826034] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.826034] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.826271] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.826357] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.827037] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f8121cb-152d-42d4-b572-d847b7bcc349" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.882976] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.883451] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.883539] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.883770] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.883871] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.884126] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.884251] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.884318] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.884477] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.884557] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.884646] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd is going to be updated. [ 740.927032] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.927181] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.927225] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.927436] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.927576] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.932647] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1669144b-ae4c-489e-95db-13be5c3bfb22: rpc.has_security_group_logging(os_id): False [ 740.938709] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd in Status: IN_PROGRESS for 2s [ 740.957698] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.957885] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.958046] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.958223] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.958326] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.958698] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.958826] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.958826] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.959116] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.959116] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.959116] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1669144b-ae4c-489e-95db-13be5c3bfb22 is going to be created. [ 741.048359] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.048582] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.048582] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.048816] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.049011] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.060593] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1669144b-ae4c-489e-95db-13be5c3bfb22 in Status: IN_PROGRESS for 2s [ 741.098127] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('35146777-fd28-4ac7-b454-f7dd3fbb5846',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.601768] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('35146777-fd28-4ac7-b454-f7dd3fbb5846',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.104717] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.105205] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.105205] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.105516] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.105516] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.105516] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 is going to be updated. [ 742.136922] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.137206] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.137206] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.137366] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.137655] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.148236] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 in Status: IN_PROGRESS for 2s [ 742.696751] env[62842]: INFO networking_nsxv3.common.synchronization [req-b4a5b010-e701-4d43-9426-7b29e190e380 req-3cff4e02-1bcc-49dc-b36e-e1fe7327eede tempest-ServerRescueTestJSONUnderV235-470641360 tempest-ServerRescueTestJSONUnderV235-470641360-project-member] Enqueued Resource ID: 4e2d19a0-11e1-464b-a466-4822ce34ca16 with Priority: HIGHEST for action security_group_members [ 742.696854] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e2d19a0-11e1-464b-a466-4822ce34ca16 with Priority: HIGHEST for action security_group_members [ 742.697314] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e2d19a0-11e1-464b-a466-4822ce34ca16 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.697314] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.697455] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.697637] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.697791] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.697883] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.699018] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.699018] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.699018] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.699018] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e2d19a0-11e1-464b-a466-4822ce34ca16',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.726331] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72454528-d410-48ed-92f0-27b44c9abb61 in Status: SUCCESS [ 742.726515] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72454528-d410-48ed-92f0-27b44c9abb61 deletion is rescheduled due to dependency. [ 742.726632] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72454528-d410-48ed-92f0-27b44c9abb61" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.948089] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd in Status: SUCCESS [ 742.949784] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd deletion is rescheduled due to dependency. [ 742.949932] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.083464] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1669144b-ae4c-489e-95db-13be5c3bfb22 in Status: SUCCESS [ 743.083681] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1669144b-ae4c-489e-95db-13be5c3bfb22" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.207423] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.207957] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.207957] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.207957] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.207957] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.208168] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.208230] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.208285] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.208916] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.208916] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.208916] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e2d19a0-11e1-464b-a466-4822ce34ca16 already deleted. [ 743.208916] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.766261] env[62842]: INFO networking_nsxv3.common.synchronization [None req-07bc7219-4b04-4ba6-ae2a-a4c98ee99f62 None None] Enqueued Resource ID: c239775d-060f-46b2-89b5-413142c39b4c with Priority: HIGHEST for action port [ 743.766998] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c239775d-060f-46b2-89b5-413142c39b4c with Priority: HIGHEST for action port [ 743.767381] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-c239775d-060f-46b2-89b5-413142c39b4c taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.767492] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c239775d-060f-46b2-89b5-413142c39b4c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.767558] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c239775d-060f-46b2-89b5-413142c39b4c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.767894] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c239775d-060f-46b2-89b5-413142c39b4c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.767989] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c239775d-060f-46b2-89b5-413142c39b4c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.874109] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-225 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.874109] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-225" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.874109] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-225" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.874109] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-225" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.874109] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.874109] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.874109] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.875081] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.875366] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.875714] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 743.876241] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 743.876472] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 743.876762] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 743.876999] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 743.877292] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 743.877607] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 743.904365] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 743.904365] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 743.904365] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 743.905937] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-225" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.905937] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-d16cb94e-a1ad-447d-88c7-b7b982b83b38 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.906188] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-d16cb94e-a1ad-447d-88c7-b7b982b83b38" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.906188] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-d16cb94e-a1ad-447d-88c7-b7b982b83b38" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.907816] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-d16cb94e-a1ad-447d-88c7-b7b982b83b38" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.907816] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d16cb94e-a1ad-447d-88c7-b7b982b83b38',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.162625] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 in Status: SUCCESS [ 744.162849] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.163029] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.163244] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.163452] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.163557] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.163621] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.163804] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.163972] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.164127] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.164265] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('35146777-fd28-4ac7-b454-f7dd3fbb5846',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.272262] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c239775d-060f-46b2-89b5-413142c39b4c [ 744.272653] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.272769] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.272895] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.273137] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.273229] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.273324] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c239775d-060f-46b2-89b5-413142c39b4c already deleted. [ 744.273405] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c239775d-060f-46b2-89b5-413142c39b4c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.409607] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.410247] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.410247] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.410451] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.410643] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.410820] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port d16cb94e-a1ad-447d-88c7-b7b982b83b38 not found, creating... [ 744.411116] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.411276] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.411684] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.411684] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.411791] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.412089] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.412465] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.412465] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.412626] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.412784] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.413246] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: d16cb94e-a1ad-447d-88c7-b7b982b83b38 is going to be created. [ 744.437208] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.437208] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.437208] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.437819] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.437819] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.438294] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-d16cb94e-a1ad-447d-88c7-b7b982b83b38" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.669263] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-35146777-fd28-4ac7-b454-f7dd3fbb5846 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.669263] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.669263] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.669263] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.669263] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.669263] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.669263] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.669263] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.669263] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.669263] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.669263] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-35146777-fd28-4ac7-b454-f7dd3fbb5846 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.669263] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.669263] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.669263] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.669263] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.669263] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.670189] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.670714] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.671411] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.671741] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.672084] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('35146777-fd28-4ac7-b454-f7dd3fbb5846',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.754784] env[62842]: INFO networking_nsxv3.common.synchronization [None req-f608e033-5117-4c92-9770-05227b9ab019 tempest-AttachVolumeTestJSON-43280943 tempest-AttachVolumeTestJSON-43280943-project-member] Enqueued Resource ID: c59f85b7-500a-400b-bef3-55b5e589248f with Priority: HIGHEST for action security_group_rules [ 744.755397] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c59f85b7-500a-400b-bef3-55b5e589248f with Priority: HIGHEST for action security_group_rules [ 744.757919] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c59f85b7-500a-400b-bef3-55b5e589248f taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.757919] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c59f85b7-500a-400b-bef3-55b5e589248f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.757919] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c59f85b7-500a-400b-bef3-55b5e589248f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.758286] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c59f85b7-500a-400b-bef3-55b5e589248f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.758403] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c59f85b7-500a-400b-bef3-55b5e589248f',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.869019] env[62842]: INFO networking_nsxv3.common.synchronization [None req-a29ccf08-d99d-411e-998b-fba748f6c521 tempest-AttachVolumeTestJSON-43280943 tempest-AttachVolumeTestJSON-43280943-project-member] Enqueued Resource ID: c59f85b7-500a-400b-bef3-55b5e589248f with Priority: HIGHEST for action security_group_rules [ 744.869336] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c59f85b7-500a-400b-bef3-55b5e589248f with Priority: HIGHEST for action security_group_rules [ 744.869890] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c59f85b7-500a-400b-bef3-55b5e589248f taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.870338] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c59f85b7-500a-400b-bef3-55b5e589248f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.175976] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 35146777-fd28-4ac7-b454-f7dd3fbb5846: rpc.has_security_group_logging(os_id): False [ 745.197608] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.197776] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.197857] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.198073] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.198189] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.198371] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.198470] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.198558] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.198668] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.198767] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.200713] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.200713] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.200713] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.200713] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.200713] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.200713] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.200713] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.200713] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.200713] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.200713] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.201099] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 is going to be updated. [ 745.272137] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.272330] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.272566] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.272696] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.272871] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.287677] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.287890] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.287964] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.288221] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.288303] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.288430] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c59f85b7-500a-400b-bef3-55b5e589248f already deleted. [ 745.288526] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c59f85b7-500a-400b-bef3-55b5e589248f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.288699] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c59f85b7-500a-400b-bef3-55b5e589248f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.288969] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c59f85b7-500a-400b-bef3-55b5e589248f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.289133] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c59f85b7-500a-400b-bef3-55b5e589248f',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.291945] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 in Status: IN_PROGRESS for 2s [ 745.333137] env[62842]: INFO networking_nsxv3.common.synchronization [req-b4a5b010-e701-4d43-9426-7b29e190e380 req-95e338b0-26b2-43a8-bd50-33dd3423e13d service nova] Enqueued Resource ID: 4e2d19a0-11e1-464b-a466-4822ce34ca16 with Priority: HIGHEST for action security_group_rules [ 745.333336] env[62842]: INFO networking_nsxv3.common.synchronization [req-b4a5b010-e701-4d43-9426-7b29e190e380 req-95e338b0-26b2-43a8-bd50-33dd3423e13d service nova] Enqueued Resource ID: 4e2d19a0-11e1-464b-a466-4822ce34ca16 with Priority: HIGHEST for action security_group_members [ 745.333485] env[62842]: INFO networking_nsxv3.common.synchronization [req-b4a5b010-e701-4d43-9426-7b29e190e380 req-95e338b0-26b2-43a8-bd50-33dd3423e13d service nova] Enqueued Resource ID: d16cb94e-a1ad-447d-88c7-b7b982b83b38 with Priority: HIGHEST for action port [ 745.334348] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e2d19a0-11e1-464b-a466-4822ce34ca16 with Priority: HIGHEST for action security_group_rules [ 745.334501] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e2d19a0-11e1-464b-a466-4822ce34ca16 with Priority: HIGHEST for action security_group_members [ 745.334612] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d16cb94e-a1ad-447d-88c7-b7b982b83b38 with Priority: HIGHEST for action port [ 745.335779] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e2d19a0-11e1-464b-a466-4822ce34ca16 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.335779] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.335779] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.335779] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.335779] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e2d19a0-11e1-464b-a466-4822ce34ca16',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.338684] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e2d19a0-11e1-464b-a466-4822ce34ca16 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.338791] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.338879] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.339211] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.339573] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.339573] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.339763] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.339763] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.339877] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.339925] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e2d19a0-11e1-464b-a466-4822ce34ca16',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.344025] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-d16cb94e-a1ad-447d-88c7-b7b982b83b38 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.344025] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d16cb94e-a1ad-447d-88c7-b7b982b83b38" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.344025] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d16cb94e-a1ad-447d-88c7-b7b982b83b38" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.344025] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d16cb94e-a1ad-447d-88c7-b7b982b83b38" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.344025] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d16cb94e-a1ad-447d-88c7-b7b982b83b38',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.820754] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.821723] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.821905] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.822166] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.822262] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.822374] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c59f85b7-500a-400b-bef3-55b5e589248f already deleted. [ 745.822456] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c59f85b7-500a-400b-bef3-55b5e589248f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.847074] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e2d19a0-11e1-464b-a466-4822ce34ca16',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.847074] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e2d19a0-11e1-464b-a466-4822ce34ca16 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.847074] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.847074] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d16cb94e-a1ad-447d-88c7-b7b982b83b38 with status ACTIVE [ 745.847074] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.847074] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.847074] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.847074] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.847074] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.847074] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.847074] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.847074] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.847074] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.847074] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.848159] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.848159] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.848159] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.848159] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.848159] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.848159] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d16cb94e-a1ad-447d-88c7-b7b982b83b38 is going to be updated. [ 745.876065] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.876254] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.876331] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.876551] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.876688] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.876867] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d16cb94e-a1ad-447d-88c7-b7b982b83b38" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.943055] env[62842]: INFO networking_nsxv3.common.synchronization [req-c3f39694-4cf1-4e8b-b553-de844371e6c7 req-82ef76eb-7ab3-4e89-9b09-6036e1aac177 tempest-ServersTestManualDisk-131723153 tempest-ServersTestManualDisk-131723153-project-member] Enqueued Resource ID: eb447582-c572-481b-befa-98a3dcf064c3 with Priority: HIGHEST for action security_group_members [ 745.943619] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb447582-c572-481b-befa-98a3dcf064c3 with Priority: HIGHEST for action security_group_members [ 745.943993] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb447582-c572-481b-befa-98a3dcf064c3 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.944058] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb447582-c572-481b-befa-98a3dcf064c3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.944177] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb447582-c572-481b-befa-98a3dcf064c3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.944388] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb447582-c572-481b-befa-98a3dcf064c3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.944554] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.944657] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.944717] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.944868] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.944953] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.945325] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb447582-c572-481b-befa-98a3dcf064c3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.339299] env[62842]: INFO networking_nsxv3.common.synchronization [None req-da241e7c-402a-4439-913b-d901203c7b31 None None] Enqueued Resource ID: 9d661041-eb94-438b-8c7d-4a1fdf254fbc with Priority: HIGHEST for action port [ 746.339299] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d661041-eb94-438b-8c7d-4a1fdf254fbc with Priority: HIGHEST for action port [ 746.339299] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d661041-eb94-438b-8c7d-4a1fdf254fbc taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.339299] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d661041-eb94-438b-8c7d-4a1fdf254fbc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.339299] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d661041-eb94-438b-8c7d-4a1fdf254fbc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.339299] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d661041-eb94-438b-8c7d-4a1fdf254fbc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.339299] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d661041-eb94-438b-8c7d-4a1fdf254fbc',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.351405] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e2d19a0-11e1-464b-a466-4822ce34ca16',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.445997] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-106 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.447482] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-106" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.447524] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-106" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.448503] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-106" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.448503] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.448503] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.448667] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.449796] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.449796] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.449796] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 746.449796] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 746.449796] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 746.450024] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 746.450024] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 746.450138] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 746.450299] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 746.455231] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.455231] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.455231] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.455653] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.455653] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.455653] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.455759] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.455759] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.455887] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.455957] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.456065] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb447582-c572-481b-befa-98a3dcf064c3 already deleted. [ 746.456141] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb447582-c572-481b-befa-98a3dcf064c3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.477832] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 746.477832] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 746.477832] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 746.477832] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-106" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.477832] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-85e0e001-a48c-44f5-9af8-507472ede16b taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.477832] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-85e0e001-a48c-44f5-9af8-507472ede16b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.477832] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-85e0e001-a48c-44f5-9af8-507472ede16b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.477832] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-85e0e001-a48c-44f5-9af8-507472ede16b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.477832] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85e0e001-a48c-44f5-9af8-507472ede16b',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.841556] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9d661041-eb94-438b-8c7d-4a1fdf254fbc [ 746.841854] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.842018] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.842093] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.842331] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.842449] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.842564] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9d661041-eb94-438b-8c7d-4a1fdf254fbc already deleted. [ 746.842649] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d661041-eb94-438b-8c7d-4a1fdf254fbc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.854313] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.854499] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.854677] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.854733] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.854851] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.855018] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e2d19a0-11e1-464b-a466-4822ce34ca16 is going to be created. [ 746.882823] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.882823] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.882823] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.882823] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.882823] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.894829] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e2d19a0-11e1-464b-a466-4822ce34ca16 in Status: UNINITIALIZED for 2s [ 746.984231] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.984508] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.984639] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.984927] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.985100] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.985406] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 85e0e001-a48c-44f5-9af8-507472ede16b not found, creating... [ 746.985739] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.985904] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.986030] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.986258] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.986400] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.986720] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.986875] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.986993] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.987390] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.987686] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.987686] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 85e0e001-a48c-44f5-9af8-507472ede16b is going to be created. [ 747.020140] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.020140] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.020140] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.020140] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.020140] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.020397] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-85e0e001-a48c-44f5-9af8-507472ede16b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.312535] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 in Status: SUCCESS [ 747.312535] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.880836] env[62842]: INFO networking_nsxv3.common.synchronization [req-c3f39694-4cf1-4e8b-b553-de844371e6c7 req-ee0ff851-2710-4356-a955-7a93332637ca service nova] Enqueued Resource ID: eb447582-c572-481b-befa-98a3dcf064c3 with Priority: HIGHEST for action security_group_rules [ 747.880836] env[62842]: INFO networking_nsxv3.common.synchronization [req-c3f39694-4cf1-4e8b-b553-de844371e6c7 req-ee0ff851-2710-4356-a955-7a93332637ca service nova] Enqueued Resource ID: eb447582-c572-481b-befa-98a3dcf064c3 with Priority: HIGHEST for action security_group_members [ 747.881158] env[62842]: INFO networking_nsxv3.common.synchronization [req-c3f39694-4cf1-4e8b-b553-de844371e6c7 req-ee0ff851-2710-4356-a955-7a93332637ca service nova] Enqueued Resource ID: 85e0e001-a48c-44f5-9af8-507472ede16b with Priority: HIGHEST for action port [ 747.885019] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb447582-c572-481b-befa-98a3dcf064c3 with Priority: HIGHEST for action security_group_rules [ 747.885019] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb447582-c572-481b-befa-98a3dcf064c3 with Priority: HIGHEST for action security_group_members [ 747.885019] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85e0e001-a48c-44f5-9af8-507472ede16b with Priority: HIGHEST for action port [ 747.885019] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb447582-c572-481b-befa-98a3dcf064c3 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.885019] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb447582-c572-481b-befa-98a3dcf064c3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.885019] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb447582-c572-481b-befa-98a3dcf064c3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.885019] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb447582-c572-481b-befa-98a3dcf064c3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.885019] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb447582-c572-481b-befa-98a3dcf064c3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.885568] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb447582-c572-481b-befa-98a3dcf064c3 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.885670] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb447582-c572-481b-befa-98a3dcf064c3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.885748] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb447582-c572-481b-befa-98a3dcf064c3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.885942] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb447582-c572-481b-befa-98a3dcf064c3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.886132] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.886232] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.886299] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.886445] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.886525] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.886648] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb447582-c572-481b-befa-98a3dcf064c3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.887921] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-85e0e001-a48c-44f5-9af8-507472ede16b taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.888047] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-85e0e001-a48c-44f5-9af8-507472ede16b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.888140] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-85e0e001-a48c-44f5-9af8-507472ede16b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.888311] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-85e0e001-a48c-44f5-9af8-507472ede16b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.888387] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85e0e001-a48c-44f5-9af8-507472ede16b',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.391215] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb447582-c572-481b-befa-98a3dcf064c3 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.391426] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb447582-c572-481b-befa-98a3dcf064c3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.391549] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 85e0e001-a48c-44f5-9af8-507472ede16b with status ACTIVE [ 748.392472] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.392472] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.392472] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.392472] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.392472] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.392472] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.392811] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.392811] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.392811] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.392811] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.392989] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.393078] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.393125] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.393761] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.393761] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.393761] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 85e0e001-a48c-44f5-9af8-507472ede16b is going to be updated. [ 748.394590] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eb447582-c572-481b-befa-98a3dcf064c3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.418151] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.418347] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.418347] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.418662] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.418754] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.418850] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-85e0e001-a48c-44f5-9af8-507472ede16b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.587203] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-434 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.587450] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-434" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.588041] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-434" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.588041] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-434" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.588324] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.588527] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.588686] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.589377] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.589377] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.589506] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 748.590193] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 748.590193] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 748.590193] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 748.590193] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 748.590383] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 748.590421] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 748.612035] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 748.612255] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 748.612469] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 748.612700] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-434" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.613078] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-b699876b-60f0-416e-9f34-d7f4c37bde78 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.613335] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-b699876b-60f0-416e-9f34-d7f4c37bde78" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.613488] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-b699876b-60f0-416e-9f34-d7f4c37bde78" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.613843] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-b699876b-60f0-416e-9f34-d7f4c37bde78" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.614065] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b699876b-60f0-416e-9f34-d7f4c37bde78',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.897215] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eb447582-c572-481b-befa-98a3dcf064c3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.906769] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e2d19a0-11e1-464b-a466-4822ce34ca16 in Status: SUCCESS [ 748.906992] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.907717] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.907808] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.907968] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.908062] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.909524] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.909524] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.909524] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.909524] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.909524] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4e2d19a0-11e1-464b-a466-4822ce34ca16',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.117360] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.117583] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.118098] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.118098] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.118192] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.118463] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.118617] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.118728] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.119021] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.119067] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.119430] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.119597] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.119713] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.119925] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.120063] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.120208] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: b699876b-60f0-416e-9f34-d7f4c37bde78 is going to be updated. [ 749.142237] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.142487] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.142558] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.142823] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.143020] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.143239] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-b699876b-60f0-416e-9f34-d7f4c37bde78" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.400159] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.400371] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.400554] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.400657] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.400748] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.400860] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb447582-c572-481b-befa-98a3dcf064c3 is going to be created. [ 749.411111] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e2d19a0-11e1-464b-a466-4822ce34ca16 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.411281] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.411614] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.411747] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.411961] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.412137] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.412224] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.412441] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.412545] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.412649] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.412838] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e2d19a0-11e1-464b-a466-4822ce34ca16 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.412937] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.413052] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.413245] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.413423] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.413550] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.413630] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.413818] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.413936] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.414063] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.414190] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4e2d19a0-11e1-464b-a466-4822ce34ca16',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.436147] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.436455] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.436455] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.436702] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.436790] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.452264] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb447582-c572-481b-befa-98a3dcf064c3 in Status: UNINITIALIZED for 2s [ 749.545503] env[62842]: INFO networking_nsxv3.common.synchronization [req-b3e0d271-6f37-4ff9-a3ca-580f327fc7ae req-ccd08b8b-e194-48b1-bb5d-ff19b0f0712e tempest-ServerActionsTestOtherA-1611322165 tempest-ServerActionsTestOtherA-1611322165-project-member] Enqueued Resource ID: a28c97db-60c3-43e3-8413-1620ac6f1f6d with Priority: HIGHEST for action security_group_members [ 749.546094] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a28c97db-60c3-43e3-8413-1620ac6f1f6d with Priority: HIGHEST for action security_group_members [ 749.546450] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-a28c97db-60c3-43e3-8413-1620ac6f1f6d taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.546692] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a28c97db-60c3-43e3-8413-1620ac6f1f6d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.546767] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a28c97db-60c3-43e3-8413-1620ac6f1f6d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.547047] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a28c97db-60c3-43e3-8413-1620ac6f1f6d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.547283] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.547446] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.547550] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.547777] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.547885] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.547987] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a28c97db-60c3-43e3-8413-1620ac6f1f6d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.916562] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4e2d19a0-11e1-464b-a466-4822ce34ca16: rpc.has_security_group_logging(os_id): False [ 749.937239] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.937423] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.937531] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.938762] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.938944] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.939200] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.939426] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.939530] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.939751] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.939874] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.940131] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.940269] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.940372] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.940557] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.940653] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.940881] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.941016] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.941104] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.941636] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.941751] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.941863] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e2d19a0-11e1-464b-a466-4822ce34ca16 is going to be created. [ 750.004918] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.005087] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.005159] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.005374] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.005561] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.011654] env[62842]: INFO networking_nsxv3.common.synchronization [req-95f56ff5-e1b3-46b9-92dd-cac6947ff636 req-75934b70-fe85-4414-85a5-9ad200edc23c service nova] Enqueued Resource ID: e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55 with Priority: HIGHEST for action security_group_rules [ 750.011808] env[62842]: INFO networking_nsxv3.common.synchronization [req-95f56ff5-e1b3-46b9-92dd-cac6947ff636 req-75934b70-fe85-4414-85a5-9ad200edc23c service nova] Enqueued Resource ID: e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55 with Priority: HIGHEST for action security_group_members [ 750.011896] env[62842]: INFO networking_nsxv3.common.synchronization [req-95f56ff5-e1b3-46b9-92dd-cac6947ff636 req-75934b70-fe85-4414-85a5-9ad200edc23c service nova] Enqueued Resource ID: b699876b-60f0-416e-9f34-d7f4c37bde78 with Priority: HIGHEST for action port [ 750.012436] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55 with Priority: HIGHEST for action security_group_rules [ 750.013229] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55 with Priority: HIGHEST for action security_group_members [ 750.013409] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b699876b-60f0-416e-9f34-d7f4c37bde78 with Priority: HIGHEST for action port [ 750.013833] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.013997] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.014103] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.014349] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.014433] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.015332] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.015481] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.015569] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.015778] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.015999] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.016141] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.016233] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.016730] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.016855] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.016973] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.017846] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-b699876b-60f0-416e-9f34-d7f4c37bde78 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.017952] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b699876b-60f0-416e-9f34-d7f4c37bde78" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.018060] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b699876b-60f0-416e-9f34-d7f4c37bde78" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.018239] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b699876b-60f0-416e-9f34-d7f4c37bde78" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.018338] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b699876b-60f0-416e-9f34-d7f4c37bde78',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.020531] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e2d19a0-11e1-464b-a466-4822ce34ca16 in Status: IN_PROGRESS for 2s [ 750.050216] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.050473] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.050566] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.050849] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.050994] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.051246] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.051347] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.051430] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.051657] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.051746] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.051838] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a28c97db-60c3-43e3-8413-1620ac6f1f6d is going to be updated. [ 750.094825] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.095052] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.095052] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.095260] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.095404] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.108484] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a28c97db-60c3-43e3-8413-1620ac6f1f6d in Status: IN_PROGRESS for 2s [ 750.519815] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.520112] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.520435] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.522285] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b699876b-60f0-416e-9f34-d7f4c37bde78 with status ACTIVE [ 750.522543] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.522755] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.522868] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.523146] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.523343] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.523635] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.523812] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.523932] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.524185] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.524357] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.524538] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.524658] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.524743] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.524932] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.525014] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.525131] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b699876b-60f0-416e-9f34-d7f4c37bde78 is going to be updated. [ 750.548275] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.548412] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.548478] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.548839] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.548907] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.549078] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b699876b-60f0-416e-9f34-d7f4c37bde78" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.027015] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.464033] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb447582-c572-481b-befa-98a3dcf064c3 in Status: SUCCESS [ 751.464258] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb447582-c572-481b-befa-98a3dcf064c3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.464457] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb447582-c572-481b-befa-98a3dcf064c3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.464701] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb447582-c572-481b-befa-98a3dcf064c3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.465368] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.465915] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.466390] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.466716] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.466875] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.467429] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb447582-c572-481b-befa-98a3dcf064c3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.467532] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eb447582-c572-481b-befa-98a3dcf064c3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.531531] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.531531] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.531531] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.531531] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.531531] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.531531] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55 is going to be updated. [ 751.564380] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.564380] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.564380] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.564380] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.564380] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.576035] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55 in Status: IN_PROGRESS for 2s [ 751.828222] env[62842]: INFO networking_nsxv3.common.synchronization [req-1921bcd8-172e-4b47-a345-1cc9ccc61deb req-f0b78902-15c7-42ef-9156-ce28f6dc8594 tempest-ServerRescueTestJSON-960362394 tempest-ServerRescueTestJSON-960362394-project-member] Enqueued Resource ID: e1bf27f4-91cf-44a6-8115-e3876163a888 with Priority: HIGHEST for action security_group_members [ 751.828222] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1bf27f4-91cf-44a6-8115-e3876163a888 with Priority: HIGHEST for action security_group_members [ 751.828892] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1bf27f4-91cf-44a6-8115-e3876163a888 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.829417] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.829682] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.829971] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.830263] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.830514] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.830664] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.830916] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.831104] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.831284] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e1bf27f4-91cf-44a6-8115-e3876163a888',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.972316] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eb447582-c572-481b-befa-98a3dcf064c3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.046456] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e2d19a0-11e1-464b-a466-4822ce34ca16 in Status: SUCCESS [ 752.046456] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.123305] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a28c97db-60c3-43e3-8413-1620ac6f1f6d in Status: SUCCESS [ 752.124303] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a28c97db-60c3-43e3-8413-1620ac6f1f6d deletion is rescheduled due to dependency. [ 752.124303] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a28c97db-60c3-43e3-8413-1620ac6f1f6d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.268791] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-660 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.269023] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-660" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.269145] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-660" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.269493] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-660" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.269769] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.269927] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.270382] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.270646] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.270803] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.271021] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 752.271142] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 752.271254] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 752.271363] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 752.271475] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 752.271621] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 752.271745] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 752.291916] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 752.292095] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 752.292238] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 752.292419] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-660" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.292733] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-8d158264-85a8-422a-8cd8-814d53084059 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.292909] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-8d158264-85a8-422a-8cd8-814d53084059" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.293113] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-8d158264-85a8-422a-8cd8-814d53084059" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.293475] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-8d158264-85a8-422a-8cd8-814d53084059" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.293620] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d158264-85a8-422a-8cd8-814d53084059',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.334919] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e1bf27f4-91cf-44a6-8115-e3876163a888',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.474790] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eb447582-c572-481b-befa-98a3dcf064c3: rpc.has_security_group_logging(os_id): False [ 752.499827] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.500008] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.500104] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.500311] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.500423] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.500667] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.500767] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.500828] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.500978] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.501077] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.501169] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb447582-c572-481b-befa-98a3dcf064c3 is going to be created. [ 752.574269] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.574269] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.574446] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.574543] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.574725] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.589373] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb447582-c572-481b-befa-98a3dcf064c3 in Status: IN_PROGRESS for 2s [ 752.799154] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.799154] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.799154] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.799154] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.799154] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.799154] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 8d158264-85a8-422a-8cd8-814d53084059 not found, creating... [ 752.799154] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.799154] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.799154] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.799154] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.799154] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.799928] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.799928] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.799928] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.799928] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.800356] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.800629] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 8d158264-85a8-422a-8cd8-814d53084059 is going to be created. [ 752.828446] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.828446] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.828446] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.828446] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.828446] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.828657] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-8d158264-85a8-422a-8cd8-814d53084059" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.837370] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e1bf27f4-91cf-44a6-8115-e3876163a888',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.339616] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.339986] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.339986] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.340160] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.340256] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.340377] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1bf27f4-91cf-44a6-8115-e3876163a888 is going to be updated. [ 753.371794] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.371981] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.372066] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.372284] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.372436] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.382646] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1bf27f4-91cf-44a6-8115-e3876163a888 in Status: IN_PROGRESS for 2s [ 753.587017] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55 in Status: SUCCESS [ 753.590861] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.590861] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.590861] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.590861] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.590861] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.590861] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.590861] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.590861] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.590861] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.590861] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.631125] env[62842]: INFO networking_nsxv3.common.synchronization [req-1921bcd8-172e-4b47-a345-1cc9ccc61deb req-1f9fd568-d6ac-4b50-af61-2c62897c4f74 service nova] Enqueued Resource ID: e1bf27f4-91cf-44a6-8115-e3876163a888 with Priority: HIGHEST for action security_group_rules [ 753.631336] env[62842]: INFO networking_nsxv3.common.synchronization [req-1921bcd8-172e-4b47-a345-1cc9ccc61deb req-1f9fd568-d6ac-4b50-af61-2c62897c4f74 service nova] Enqueued Resource ID: e1bf27f4-91cf-44a6-8115-e3876163a888 with Priority: HIGHEST for action security_group_members [ 753.631481] env[62842]: INFO networking_nsxv3.common.synchronization [req-1921bcd8-172e-4b47-a345-1cc9ccc61deb req-1f9fd568-d6ac-4b50-af61-2c62897c4f74 service nova] Enqueued Resource ID: 8d158264-85a8-422a-8cd8-814d53084059 with Priority: HIGHEST for action port [ 753.631735] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1bf27f4-91cf-44a6-8115-e3876163a888 with Priority: HIGHEST for action security_group_rules [ 753.631866] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1bf27f4-91cf-44a6-8115-e3876163a888 with Priority: HIGHEST for action security_group_members [ 753.631962] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d158264-85a8-422a-8cd8-814d53084059 with Priority: HIGHEST for action port [ 753.632498] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e1bf27f4-91cf-44a6-8115-e3876163a888 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.632621] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.632687] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.632901] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.632954] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e1bf27f4-91cf-44a6-8115-e3876163a888',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.634437] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1bf27f4-91cf-44a6-8115-e3876163a888 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.634543] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.634742] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d158264-85a8-422a-8cd8-814d53084059 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.634836] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d158264-85a8-422a-8cd8-814d53084059" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.634898] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d158264-85a8-422a-8cd8-814d53084059" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.635073] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d158264-85a8-422a-8cd8-814d53084059" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.635150] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d158264-85a8-422a-8cd8-814d53084059',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.090866] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.138220] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1bf27f4-91cf-44a6-8115-e3876163a888 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.138220] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.142036] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8d158264-85a8-422a-8cd8-814d53084059 with status ACTIVE [ 754.142245] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.142372] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.142440] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.142650] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.142739] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.142911] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.143075] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.143075] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.143242] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.143329] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.144284] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.144284] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.144284] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.144284] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.144284] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.144284] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8d158264-85a8-422a-8cd8-814d53084059 is going to be updated. [ 754.167084] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.167282] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.167348] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.167631] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.167741] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.167918] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d158264-85a8-422a-8cd8-814d53084059" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.594698] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55: rpc.has_security_group_logging(os_id): False [ 754.606717] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb447582-c572-481b-befa-98a3dcf064c3 in Status: SUCCESS [ 754.606955] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb447582-c572-481b-befa-98a3dcf064c3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.612815] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.612935] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.613537] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.613537] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.632506] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.632826] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.632973] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.633063] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.633337] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.633337] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.633431] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55 is going to be updated. [ 754.691925] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.692208] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.692341] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.692716] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.692967] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.708148] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55 in Status: IN_PROGRESS for 2s [ 755.400721] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1bf27f4-91cf-44a6-8115-e3876163a888 in Status: SUCCESS [ 755.400994] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.401146] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.401392] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.401700] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.401818] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.401818] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.401975] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.402083] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.402235] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e1bf27f4-91cf-44a6-8115-e3876163a888',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.904753] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e1bf27f4-91cf-44a6-8115-e3876163a888',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.407524] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e1bf27f4-91cf-44a6-8115-e3876163a888',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.685251] env[62842]: INFO networking_nsxv3.common.synchronization [req-3e6b8bd4-c681-4425-8f77-1207ec5f1f89 req-88b64ef0-849d-416c-b888-8b7a6c6d0cf2 tempest-ServersAdminTestJSON-1475908229 tempest-ServersAdminTestJSON-1475908229-project-member] Enqueued Resource ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e with Priority: HIGHEST for action security_group_members [ 756.685820] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e with Priority: HIGHEST for action security_group_members [ 756.686142] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.686267] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.686330] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.687163] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.687488] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.687651] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.687751] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.687987] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.688140] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.688277] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7acb0f4-6157-4a0c-977e-ee6a2808aa0e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.737187] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55 in Status: SUCCESS [ 756.737635] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.911930] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.912295] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.912295] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.912537] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.912673] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.912842] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1bf27f4-91cf-44a6-8115-e3876163a888 is going to be updated. [ 756.991154] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.991308] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.991471] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.993043] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.993043] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.007521] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1bf27f4-91cf-44a6-8115-e3876163a888 in Status: IN_PROGRESS for 2s [ 757.192789] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e7acb0f4-6157-4a0c-977e-ee6a2808aa0e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.577460] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-988 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.577460] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-988" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.580787] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-988" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.581426] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-988" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.583467] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.583958] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.584170] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.584475] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.584655] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.584911] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 757.584986] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 757.585130] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 757.585267] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 757.585414] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 757.585504] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 757.585644] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 757.612710] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 757.613179] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 757.613422] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 757.613686] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-988" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.613968] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-528c49b9-0845-4b59-a6d8-9415725801b1 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.614187] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-528c49b9-0845-4b59-a6d8-9415725801b1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.614336] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-528c49b9-0845-4b59-a6d8-9415725801b1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.614654] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-528c49b9-0845-4b59-a6d8-9415725801b1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.614800] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('528c49b9-0845-4b59-a6d8-9415725801b1',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.693274] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e7acb0f4-6157-4a0c-977e-ee6a2808aa0e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.117328] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.117724] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.117724] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.117976] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.118146] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.118302] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 528c49b9-0845-4b59-a6d8-9415725801b1 not found, creating... [ 758.118595] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.118766] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.118884] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.119127] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.119275] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.119695] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.119929] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.120242] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.120513] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.120662] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.120814] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 528c49b9-0845-4b59-a6d8-9415725801b1 is going to be created. [ 758.180532] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.180787] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.180935] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.181303] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.181576] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.181832] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-528c49b9-0845-4b59-a6d8-9415725801b1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.196870] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.197511] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.197653] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.197821] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.197963] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.198570] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e is going to be updated. [ 758.260160] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.260415] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.260495] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.260850] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.261088] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.272951] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e in Status: IN_PROGRESS for 2s [ 759.022387] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1bf27f4-91cf-44a6-8115-e3876163a888 in Status: SUCCESS [ 759.022628] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.022805] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.023069] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.023294] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.024614] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.024614] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.024614] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.024614] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.024614] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.024614] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e1bf27f4-91cf-44a6-8115-e3876163a888',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.195989] env[62842]: INFO networking_nsxv3.common.synchronization [req-bb8b1aa0-4434-47b3-b520-fdb214278cbc req-caf5fdc1-b130-4784-9633-bb8c076c8640 tempest-ImagesOneServerTestJSON-464456993 tempest-ImagesOneServerTestJSON-464456993-project-member] Enqueued Resource ID: 37227a37-3f98-483a-add1-7f595a53cc2b with Priority: HIGHEST for action security_group_members [ 759.200356] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37227a37-3f98-483a-add1-7f595a53cc2b with Priority: HIGHEST for action security_group_members [ 759.202239] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-37227a37-3f98-483a-add1-7f595a53cc2b taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.206443] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37227a37-3f98-483a-add1-7f595a53cc2b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.206689] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37227a37-3f98-483a-add1-7f595a53cc2b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.207051] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37227a37-3f98-483a-add1-7f595a53cc2b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.207288] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.207791] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.207791] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.207935] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.207992] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.208244] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37227a37-3f98-483a-add1-7f595a53cc2b',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.531371] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1bf27f4-91cf-44a6-8115-e3876163a888 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.531371] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.531371] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.531371] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.531371] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.531371] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.531371] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.531371] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.531371] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.531371] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.531371] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1bf27f4-91cf-44a6-8115-e3876163a888 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.531371] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.531371] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.531371] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.531371] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.531371] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.531987] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.531987] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.531987] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.531987] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.531987] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e1bf27f4-91cf-44a6-8115-e3876163a888',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.653174] env[62842]: INFO networking_nsxv3.common.synchronization [None req-6dedb183-ae19-4173-95bf-fd7c8ba481c5 None None] Enqueued Resource ID: 2cf4f866-25e3-4c39-8d94-cb8071b1d637 with Priority: HIGHEST for action port [ 759.653174] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cf4f866-25e3-4c39-8d94-cb8071b1d637 with Priority: HIGHEST for action port [ 759.653174] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-2cf4f866-25e3-4c39-8d94-cb8071b1d637 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.653174] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2cf4f866-25e3-4c39-8d94-cb8071b1d637" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.655453] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2cf4f866-25e3-4c39-8d94-cb8071b1d637" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.656045] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2cf4f866-25e3-4c39-8d94-cb8071b1d637" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.656422] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2cf4f866-25e3-4c39-8d94-cb8071b1d637',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.712555] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.712773] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.712842] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.713082] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.713190] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.713420] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.713526] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.713590] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.713744] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.713819] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.714029] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37227a37-3f98-483a-add1-7f595a53cc2b is going to be updated. [ 759.780969] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.780969] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.780969] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.780969] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.780969] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.797830] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37227a37-3f98-483a-add1-7f595a53cc2b in Status: IN_PROGRESS for 2s [ 759.870113] env[62842]: INFO networking_nsxv3.common.synchronization [req-3e6b8bd4-c681-4425-8f77-1207ec5f1f89 req-e9cf9d9a-ba4d-4a77-beae-55a1ae65ec40 service nova] Enqueued Resource ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e with Priority: HIGHEST for action security_group_rules [ 759.870505] env[62842]: INFO networking_nsxv3.common.synchronization [req-3e6b8bd4-c681-4425-8f77-1207ec5f1f89 req-e9cf9d9a-ba4d-4a77-beae-55a1ae65ec40 service nova] Enqueued Resource ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e with Priority: HIGHEST for action security_group_members [ 759.870606] env[62842]: INFO networking_nsxv3.common.synchronization [req-3e6b8bd4-c681-4425-8f77-1207ec5f1f89 req-e9cf9d9a-ba4d-4a77-beae-55a1ae65ec40 service nova] Enqueued Resource ID: 528c49b9-0845-4b59-a6d8-9415725801b1 with Priority: HIGHEST for action port [ 759.871212] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e with Priority: HIGHEST for action security_group_rules [ 759.871426] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e with Priority: HIGHEST for action security_group_members [ 759.871539] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 528c49b9-0845-4b59-a6d8-9415725801b1 with Priority: HIGHEST for action port [ 759.871759] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.871873] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.871956] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.872173] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.872244] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7acb0f4-6157-4a0c-977e-ee6a2808aa0e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.875190] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.875190] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.875190] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-528c49b9-0845-4b59-a6d8-9415725801b1 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.875190] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-528c49b9-0845-4b59-a6d8-9415725801b1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.875190] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-528c49b9-0845-4b59-a6d8-9415725801b1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.875190] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-528c49b9-0845-4b59-a6d8-9415725801b1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.875190] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('528c49b9-0845-4b59-a6d8-9415725801b1',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.034503] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e1bf27f4-91cf-44a6-8115-e3876163a888: rpc.has_security_group_logging(os_id): False [ 760.062778] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.062778] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.062778] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.062778] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.062778] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.062778] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.062778] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.062778] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.062778] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.062778] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.062778] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.062778] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.062778] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.062778] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.062778] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.066832] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.066832] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.066832] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.066832] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.066832] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.066832] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e1bf27f4-91cf-44a6-8115-e3876163a888 is going to be updated. [ 760.156936] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.157114] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.157114] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.157333] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.157524] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.158698] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2cf4f866-25e3-4c39-8d94-cb8071b1d637 [ 760.158933] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.159067] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.159067] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.159227] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.159305] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.159411] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2cf4f866-25e3-4c39-8d94-cb8071b1d637 already deleted. [ 760.159496] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2cf4f866-25e3-4c39-8d94-cb8071b1d637" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.186729] env[62842]: INFO networking_nsxv3.common.synchronization [req-56eb8534-61a3-40bb-ab00-081a397df166 req-edcb4639-7267-4005-ae1f-c4aafd9d041b tempest-ServersNegativeTestMultiTenantJSON-932162800 tempest-ServersNegativeTestMultiTenantJSON-932162800-project-member] Enqueued Resource ID: a14df1d2-b3a6-4075-b15b-967892c37b7e with Priority: HIGHEST for action security_group_members [ 760.189121] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e1bf27f4-91cf-44a6-8115-e3876163a888 in Status: IN_PROGRESS for 2s [ 760.189121] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a14df1d2-b3a6-4075-b15b-967892c37b7e with Priority: HIGHEST for action security_group_members [ 760.189540] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-a14df1d2-b3a6-4075-b15b-967892c37b7e taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.189770] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a14df1d2-b3a6-4075-b15b-967892c37b7e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.189770] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a14df1d2-b3a6-4075-b15b-967892c37b7e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.190056] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a14df1d2-b3a6-4075-b15b-967892c37b7e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.191045] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.191165] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.191165] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.191826] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.191826] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.191826] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a14df1d2-b3a6-4075-b15b-967892c37b7e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.290254] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e in Status: SUCCESS [ 760.290655] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.290701] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.292077] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.292077] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.292077] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.292077] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.292077] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.292077] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.292077] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7acb0f4-6157-4a0c-977e-ee6a2808aa0e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.377499] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.377658] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.380101] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 528c49b9-0845-4b59-a6d8-9415725801b1 with status ACTIVE [ 760.380391] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.380554] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.380606] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.384034] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.384034] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.384034] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.384034] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.384034] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.384034] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.384034] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.384034] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.384034] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.384034] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.384034] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.384034] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.384034] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 528c49b9-0845-4b59-a6d8-9415725801b1 is going to be updated. [ 760.412323] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.412323] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.412323] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.412323] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.412323] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.412323] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-528c49b9-0845-4b59-a6d8-9415725801b1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.696157] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.697361] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.697670] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.699066] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.699066] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.699659] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.699659] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.699659] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.699816] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.699986] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.700145] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a14df1d2-b3a6-4075-b15b-967892c37b7e already deleted. [ 760.700322] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a14df1d2-b3a6-4075-b15b-967892c37b7e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.794680] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e7acb0f4-6157-4a0c-977e-ee6a2808aa0e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.297707] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e7acb0f4-6157-4a0c-977e-ee6a2808aa0e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.673445] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-185 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.673648] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-185" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.673744] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-185" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.674123] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-185" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.674395] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.674552] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.674675] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.674953] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.678973] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.679336] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 761.679542] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 761.679693] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 761.680183] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 761.680343] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 761.680467] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 761.680633] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 761.704126] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 761.704326] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 761.704507] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 761.704616] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-185" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.704937] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-af0f6804-eaaa-4142-b0b2-66b8b1f3c392 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.705125] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-af0f6804-eaaa-4142-b0b2-66b8b1f3c392" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.705236] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-af0f6804-eaaa-4142-b0b2-66b8b1f3c392" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.705579] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-af0f6804-eaaa-4142-b0b2-66b8b1f3c392" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.705724] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af0f6804-eaaa-4142-b0b2-66b8b1f3c392',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.800655] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.800892] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.800892] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.801125] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.801221] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.801324] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e is going to be updated. [ 761.819171] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37227a37-3f98-483a-add1-7f595a53cc2b in Status: SUCCESS [ 761.819455] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37227a37-3f98-483a-add1-7f595a53cc2b deletion is rescheduled due to dependency. [ 761.819636] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37227a37-3f98-483a-add1-7f595a53cc2b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.838701] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.838701] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.839045] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.839045] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.839159] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.850712] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e in Status: IN_PROGRESS for 2s [ 762.030657] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.030901] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.030974] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.031247] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.031360] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.138575] env[62842]: INFO networking_nsxv3.common.synchronization [req-3b37f060-cb4b-4dba-b12b-447b09458d84 req-adc41dcd-99a5-4f94-84fd-b616699e1904 tempest-ServersTestJSON-1961539448 tempest-ServersTestJSON-1961539448-project-member] Enqueued Resource ID: 2d753783-8988-4639-a0fc-596bf03e413b with Priority: HIGHEST for action security_group_members [ 762.139255] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d753783-8988-4639-a0fc-596bf03e413b with Priority: HIGHEST for action security_group_members [ 762.139762] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d753783-8988-4639-a0fc-596bf03e413b taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.139762] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d753783-8988-4639-a0fc-596bf03e413b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.139917] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d753783-8988-4639-a0fc-596bf03e413b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.140052] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d753783-8988-4639-a0fc-596bf03e413b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.140209] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.140308] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.140388] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.140544] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.140624] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.140716] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d753783-8988-4639-a0fc-596bf03e413b',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.204667] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e1bf27f4-91cf-44a6-8115-e3876163a888 in Status: SUCCESS [ 762.205383] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.208324] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.208523] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.208650] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.211050] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.211050] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.211050] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port af0f6804-eaaa-4142-b0b2-66b8b1f3c392 not found, creating... [ 762.211050] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.211389] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.211389] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.211674] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.212326] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.212718] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.212939] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.213080] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.213423] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.213517] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.213708] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: af0f6804-eaaa-4142-b0b2-66b8b1f3c392 is going to be created. [ 762.240336] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.240584] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.240738] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.241360] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.241360] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.241550] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-af0f6804-eaaa-4142-b0b2-66b8b1f3c392" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.534343] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.642757] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.642933] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.642933] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.643207] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.643247] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.645356] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.645356] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.645356] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.645356] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.645356] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.645356] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d753783-8988-4639-a0fc-596bf03e413b is going to be updated. [ 762.677438] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.677438] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.677438] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.677438] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.677438] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.688253] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d753783-8988-4639-a0fc-596bf03e413b in Status: IN_PROGRESS for 2s [ 762.735375] env[62842]: INFO networking_nsxv3.common.synchronization [None req-a236e9ac-0e90-4579-b483-a3d560332eee tempest-AttachInterfacesTestJSON-2140085841 tempest-AttachInterfacesTestJSON-2140085841-project-member] Enqueued Resource ID: e509406e-18a0-4842-8350-5830bdc3ec79 with Priority: HIGHEST for action security_group_rules [ 762.735375] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e509406e-18a0-4842-8350-5830bdc3ec79 with Priority: HIGHEST for action security_group_rules [ 762.735375] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e509406e-18a0-4842-8350-5830bdc3ec79 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.735375] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e509406e-18a0-4842-8350-5830bdc3ec79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.735375] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e509406e-18a0-4842-8350-5830bdc3ec79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.735375] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e509406e-18a0-4842-8350-5830bdc3ec79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.735375] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e509406e-18a0-4842-8350-5830bdc3ec79',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.794195] env[62842]: INFO networking_nsxv3.common.synchronization [None req-ed1615b5-108a-4fcd-b451-5d256826a9a8 None None] Enqueued Resource ID: 8a472f40-fab4-47c4-ae8a-390048e5606b with Priority: HIGHEST for action port [ 762.795211] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a472f40-fab4-47c4-ae8a-390048e5606b with Priority: HIGHEST for action port [ 762.795467] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a472f40-fab4-47c4-ae8a-390048e5606b taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.795636] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a472f40-fab4-47c4-ae8a-390048e5606b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.795721] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a472f40-fab4-47c4-ae8a-390048e5606b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.796108] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a472f40-fab4-47c4-ae8a-390048e5606b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.796222] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a472f40-fab4-47c4-ae8a-390048e5606b',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.867355] env[62842]: INFO networking_nsxv3.common.synchronization [None req-14d82775-df51-4bd3-b8e2-1605b0a3d81b tempest-AttachInterfacesTestJSON-2140085841 tempest-AttachInterfacesTestJSON-2140085841-project-member] Enqueued Resource ID: e509406e-18a0-4842-8350-5830bdc3ec79 with Priority: HIGHEST for action security_group_rules [ 762.867901] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e509406e-18a0-4842-8350-5830bdc3ec79 with Priority: HIGHEST for action security_group_rules [ 762.868241] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e509406e-18a0-4842-8350-5830bdc3ec79 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.868346] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e509406e-18a0-4842-8350-5830bdc3ec79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.040368] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.261888] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.261888] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.261888] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.261888] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.261888] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.261888] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e509406e-18a0-4842-8350-5830bdc3ec79 already deleted. [ 763.261888] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e509406e-18a0-4842-8350-5830bdc3ec79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.261888] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e509406e-18a0-4842-8350-5830bdc3ec79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.261888] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e509406e-18a0-4842-8350-5830bdc3ec79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.261888] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e509406e-18a0-4842-8350-5830bdc3ec79',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.299668] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8a472f40-fab4-47c4-ae8a-390048e5606b [ 763.300147] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.300629] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.301208] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.301976] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.302224] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.302465] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8a472f40-fab4-47c4-ae8a-390048e5606b already deleted. [ 763.302681] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a472f40-fab4-47c4-ae8a-390048e5606b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.443029] env[62842]: INFO networking_nsxv3.common.synchronization [req-56eb8534-61a3-40bb-ab00-081a397df166 req-3e7803fb-2a8a-4a63-b3ac-b4aa0dc92a3a service nova] Enqueued Resource ID: a14df1d2-b3a6-4075-b15b-967892c37b7e with Priority: HIGHEST for action security_group_rules [ 763.443029] env[62842]: INFO networking_nsxv3.common.synchronization [req-56eb8534-61a3-40bb-ab00-081a397df166 req-3e7803fb-2a8a-4a63-b3ac-b4aa0dc92a3a service nova] Enqueued Resource ID: a14df1d2-b3a6-4075-b15b-967892c37b7e with Priority: HIGHEST for action security_group_members [ 763.443029] env[62842]: INFO networking_nsxv3.common.synchronization [req-56eb8534-61a3-40bb-ab00-081a397df166 req-3e7803fb-2a8a-4a63-b3ac-b4aa0dc92a3a service nova] Enqueued Resource ID: af0f6804-eaaa-4142-b0b2-66b8b1f3c392 with Priority: HIGHEST for action port [ 763.443029] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a14df1d2-b3a6-4075-b15b-967892c37b7e with Priority: HIGHEST for action security_group_rules [ 763.443455] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a14df1d2-b3a6-4075-b15b-967892c37b7e with Priority: HIGHEST for action security_group_members [ 763.443662] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af0f6804-eaaa-4142-b0b2-66b8b1f3c392 with Priority: HIGHEST for action port [ 763.446060] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a14df1d2-b3a6-4075-b15b-967892c37b7e taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.446060] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a14df1d2-b3a6-4075-b15b-967892c37b7e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.446060] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a14df1d2-b3a6-4075-b15b-967892c37b7e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.446060] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a14df1d2-b3a6-4075-b15b-967892c37b7e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.446060] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a14df1d2-b3a6-4075-b15b-967892c37b7e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.447792] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-a14df1d2-b3a6-4075-b15b-967892c37b7e taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.450017] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a14df1d2-b3a6-4075-b15b-967892c37b7e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.450017] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a14df1d2-b3a6-4075-b15b-967892c37b7e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.450017] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a14df1d2-b3a6-4075-b15b-967892c37b7e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.450017] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.450017] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.450017] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.450017] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.450017] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.450017] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a14df1d2-b3a6-4075-b15b-967892c37b7e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.451471] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-af0f6804-eaaa-4142-b0b2-66b8b1f3c392 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.451710] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af0f6804-eaaa-4142-b0b2-66b8b1f3c392" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.451873] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af0f6804-eaaa-4142-b0b2-66b8b1f3c392" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.452127] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af0f6804-eaaa-4142-b0b2-66b8b1f3c392" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.452994] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af0f6804-eaaa-4142-b0b2-66b8b1f3c392',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.546410] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 763.546410] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 763.663701] env[62842]: INFO networking_nsxv3.common.synchronization [req-2c2843bf-ff28-463b-966b-9352c1c710d0 req-cae7eeff-5008-47d5-a123-2676c2bad9ac tempest-DeleteServersTestJSON-1113791748 tempest-DeleteServersTestJSON-1113791748-project-member] Enqueued Resource ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 with Priority: HIGHEST for action security_group_members [ 763.664064] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 with Priority: HIGHEST for action security_group_members [ 763.664370] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-35146777-fd28-4ac7-b454-f7dd3fbb5846 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.664494] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.664560] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.664794] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.664916] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.665386] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.665549] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.665669] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.665886] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.665886] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('35146777-fd28-4ac7-b454-f7dd3fbb5846',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.814280] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.814280] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.814280] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.814280] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.814280] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.814280] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e509406e-18a0-4842-8350-5830bdc3ec79 already deleted. [ 763.814280] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e509406e-18a0-4842-8350-5830bdc3ec79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.862593] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e in Status: SUCCESS [ 763.862593] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.862593] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.862837] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.863067] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.863067] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.863208] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.863303] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.863338] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.863449] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.864599] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e7acb0f4-6157-4a0c-977e-ee6a2808aa0e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.948167] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-a14df1d2-b3a6-4075-b15b-967892c37b7e taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.950042] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a14df1d2-b3a6-4075-b15b-967892c37b7e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.954435] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port af0f6804-eaaa-4142-b0b2-66b8b1f3c392 with status ACTIVE [ 763.954648] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.954777] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.954844] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.955394] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.955394] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.955394] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.955551] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.955551] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.955619] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.955673] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.956045] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.956045] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.956045] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.956161] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.956270] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.956270] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: af0f6804-eaaa-4142-b0b2-66b8b1f3c392 is going to be updated. [ 763.957312] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a14df1d2-b3a6-4075-b15b-967892c37b7e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.978812] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.978945] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.979027] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.979294] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.979506] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.979506] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af0f6804-eaaa-4142-b0b2-66b8b1f3c392" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.167643] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.167822] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.167903] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.168164] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.168264] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.168479] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.168580] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.168644] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.168855] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.168949] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.169053] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 is going to be updated. [ 764.212559] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.212559] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.212559] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.212559] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.212559] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.222935] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 in Status: IN_PROGRESS for 2s [ 764.367064] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.367260] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.367390] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.367631] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.368086] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.368252] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.368329] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.368542] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.368639] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.368754] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.369030] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.369764] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.369764] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.369764] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.369764] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.370045] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.370045] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.370183] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.370557] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.370557] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.370889] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e7acb0f4-6157-4a0c-977e-ee6a2808aa0e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.462441] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a14df1d2-b3a6-4075-b15b-967892c37b7e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.637666] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.638075] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.638075] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.638218] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.657910] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 764.658819] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.659962] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 764.691301] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.691474] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.691520] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.692400] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.698122] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.698718] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 764.698821] env[62842]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=62842) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 764.698904] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 764.711622] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d753783-8988-4639-a0fc-596bf03e413b in Status: IN_PROGRESS for 4s [ 764.745959] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.746188] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.746188] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.746412] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.749314] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.749314] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 764.859473] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.859721] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.859788] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.860431] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.860573] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.861439] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 764.874035] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e7acb0f4-6157-4a0c-977e-ee6a2808aa0e: rpc.has_security_group_logging(os_id): False [ 764.896825] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.896954] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.896954] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.897221] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.919362] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.919546] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.919636] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.919712] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.919921] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.920018] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.920405] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.920492] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.920576] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.920765] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.920839] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.921110] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.921528] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.921528] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.921528] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.921528] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.921910] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e is going to be updated. [ 764.948677] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.948677] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.948677] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.948677] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.948677] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.949043] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:35. [ 764.949330] env[62842]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'473d98b1-ea12-43f6-8749-401a513b928c', '3f89b292-3278-4b67-9a1b-21e48a9ef380', 'e1bf27f4-91cf-44a6-8115-e3876163a888', 'b321faa1-947f-4c79-ac72-202730c0dcd1', '0a03224f-b75b-48a5-9e23-3ca50aabbb33', '37227a37-3f98-483a-add1-7f595a53cc2b', 'b132ea78-a4b4-47a2-98dc-0d195c085bca', 'fe43e864-555f-4ea5-8841-d2bcacb15ecc', '5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393', '82e532f4-b8b0-4a4a-affc-1ab5a63253cd', 'eb447582-c572-481b-befa-98a3dcf064c3', '3a92b1e9-7c4f-4a77-a09f-3ba0782fff02', '38065a18-23d4-472c-902b-3e37fa7fb4aa', 'd1d35af8-d196-4dd3-b8df-9b98089c1606', '66f4c424-4062-4ad5-867d-4d48776176cd', '92cba5b3-76df-405c-acab-0f3155ce22e5', '38b4d382-6400-4588-b620-faecfba1fd64', '35146777-fd28-4ac7-b454-f7dd3fbb5846', 'ccb27bcf-56d8-49d9-af51-9eb4b1211bce', 'e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55', 'c0ccbbde-9e94-45de-b00c-8f135b84465d', '331dd47d-e3b4-4338-b588-cd456a9aa5f7', '2d753783-8988-4639-a0fc-596bf03e413b', '72454528-d410-48ed-92f0-27b44c9abb61', '4e2d19a0-11e1-464b-a466-4822ce34ca16', '3a595937-aa58-40f8-a3cf-b57a814011e8', '16baecd6-bda3-40e1-98ef-4e238a3fc354', 'd014d213-d805-403a-bcc9-8c66da8eefa2', '1648554a-7f11-49bf-b9b2-6edf888e2ce9', '1669144b-ae4c-489e-95db-13be5c3bfb22', '534d1af9-5f3d-417d-8cb4-3116f2425761', 'e7acb0f4-6157-4a0c-977e-ee6a2808aa0e', '5704e4e3-8211-4e30-b474-06c668cf060d', 'a28c97db-60c3-43e3-8413-1620ac6f1f6d', 'cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37'} {{(pid=62842) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 764.949330] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 764.967956] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.968191] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.968258] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.968547] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.968547] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.968645] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a14df1d2-b3a6-4075-b15b-967892c37b7e is going to be created. [ 764.971457] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.971652] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.971652] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.971845] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.971952] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.972068] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 764.972157] env[62842]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=62842) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 764.972209] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 764.995725] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.996489] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.996489] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.996489] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.996638] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.012658] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a14df1d2-b3a6-4075-b15b-967892c37b7e in Status: UNINITIALIZED for 2s [ 765.015123] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.015291] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.015397] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.015585] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.015703] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.032540] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e in Status: IN_PROGRESS for 2s [ 765.049584] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.049772] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.049818] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.050034] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.050791] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.051020] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 765.051442] env[62842]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=62842) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 765.051522] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 765.051589] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 765.051669] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/35 resources of Type:Security Group Rules [ 765.051763] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 473d98b1-ea12-43f6-8749-401a513b928c with Priority: HIGH for action security_group_rules [ 765.051856] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3f89b292-3278-4b67-9a1b-21e48a9ef380 with Priority: HIGH for action security_group_rules [ 765.051925] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e1bf27f4-91cf-44a6-8115-e3876163a888 with Priority: HIGH for action security_group_rules [ 765.051986] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b321faa1-947f-4c79-ac72-202730c0dcd1 with Priority: HIGH for action security_group_rules [ 765.052059] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 with Priority: HIGH for action security_group_rules [ 765.052119] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 37227a37-3f98-483a-add1-7f595a53cc2b with Priority: HIGH for action security_group_rules [ 765.052179] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b132ea78-a4b4-47a2-98dc-0d195c085bca with Priority: HIGH for action security_group_rules [ 765.052267] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fe43e864-555f-4ea5-8841-d2bcacb15ecc with Priority: HIGH for action security_group_rules [ 765.052315] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 with Priority: HIGH for action security_group_rules [ 765.052600] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd with Priority: HIGH for action security_group_rules [ 765.052689] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: eb447582-c572-481b-befa-98a3dcf064c3 with Priority: HIGH for action security_group_rules [ 765.052750] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3a92b1e9-7c4f-4a77-a09f-3ba0782fff02 with Priority: HIGH for action security_group_rules [ 765.052843] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 38065a18-23d4-472c-902b-3e37fa7fb4aa with Priority: HIGH for action security_group_rules [ 765.052883] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d1d35af8-d196-4dd3-b8df-9b98089c1606 with Priority: HIGH for action security_group_rules [ 765.052924] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 66f4c424-4062-4ad5-867d-4d48776176cd with Priority: HIGH for action security_group_rules [ 765.052984] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 92cba5b3-76df-405c-acab-0f3155ce22e5 with Priority: HIGH for action security_group_rules [ 765.053096] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 38b4d382-6400-4588-b620-faecfba1fd64 with Priority: HIGH for action security_group_rules [ 765.053141] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 with Priority: HIGH for action security_group_rules [ 765.053181] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ccb27bcf-56d8-49d9-af51-9eb4b1211bce with Priority: HIGH for action security_group_rules [ 765.053225] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55 with Priority: HIGH for action security_group_rules [ 765.053330] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.236248] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 in Status: SUCCESS [ 766.236248] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 deletion is rescheduled due to dependency. [ 766.236248] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.723533] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d753783-8988-4639-a0fc-596bf03e413b in Status: SUCCESS [ 766.723736] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d753783-8988-4639-a0fc-596bf03e413b deletion is rescheduled due to dependency. [ 766.723899] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d753783-8988-4639-a0fc-596bf03e413b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.738184] env[62842]: INFO networking_nsxv3.common.synchronization [None req-db55f745-b672-47c6-bda1-84a49a1905bd tempest-ServerActionsTestJSON-670456711 tempest-ServerActionsTestJSON-670456711-project-member] Enqueued Resource ID: 03708cfa-ea22-40d4-8c09-177242e076fa with Priority: HIGHEST for action security_group_rules [ 766.738946] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03708cfa-ea22-40d4-8c09-177242e076fa with Priority: HIGHEST for action security_group_rules [ 766.741175] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 473d98b1-ea12-43f6-8749-401a513b928c with Priority: HIGH for action security_group_rules [ 766.741306] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1bf27f4-91cf-44a6-8115-e3876163a888 with Priority: HIGH for action security_group_rules [ 766.741459] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b132ea78-a4b4-47a2-98dc-0d195c085bca with Priority: HIGH for action security_group_rules [ 766.741703] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66f4c424-4062-4ad5-867d-4d48776176cd with Priority: HIGH for action security_group_rules [ 766.741703] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55 with Priority: HIGH for action security_group_rules [ 766.741850] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccb27bcf-56d8-49d9-af51-9eb4b1211bce with Priority: HIGH for action security_group_rules [ 766.741899] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 with Priority: HIGH for action security_group_rules [ 766.741949] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38b4d382-6400-4588-b620-faecfba1fd64 with Priority: HIGH for action security_group_rules [ 766.742083] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1d35af8-d196-4dd3-b8df-9b98089c1606 with Priority: HIGH for action security_group_rules [ 766.742194] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92cba5b3-76df-405c-acab-0f3155ce22e5 with Priority: HIGH for action security_group_rules [ 766.742282] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38065a18-23d4-472c-902b-3e37fa7fb4aa with Priority: HIGH for action security_group_rules [ 766.742356] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a92b1e9-7c4f-4a77-a09f-3ba0782fff02 with Priority: HIGH for action security_group_rules [ 766.742437] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb447582-c572-481b-befa-98a3dcf064c3 with Priority: HIGH for action security_group_rules [ 766.742514] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd with Priority: HIGH for action security_group_rules [ 766.742586] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 with Priority: HIGH for action security_group_rules [ 766.742670] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37227a37-3f98-483a-add1-7f595a53cc2b with Priority: HIGH for action security_group_rules [ 766.742732] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe43e864-555f-4ea5-8841-d2bcacb15ecc with Priority: HIGH for action security_group_rules [ 766.742790] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 with Priority: HIGH for action security_group_rules [ 766.743209] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f89b292-3278-4b67-9a1b-21e48a9ef380 with Priority: HIGH for action security_group_rules [ 766.743209] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b321faa1-947f-4c79-ac72-202730c0dcd1 with Priority: HIGH for action security_group_rules [ 766.748394] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-03708cfa-ea22-40d4-8c09-177242e076fa taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.748643] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-03708cfa-ea22-40d4-8c09-177242e076fa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.748743] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-03708cfa-ea22-40d4-8c09-177242e076fa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.749274] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-03708cfa-ea22-40d4-8c09-177242e076fa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.749274] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('03708cfa-ea22-40d4-8c09-177242e076fa',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.750743] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-473d98b1-ea12-43f6-8749-401a513b928c taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.750851] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-473d98b1-ea12-43f6-8749-401a513b928c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.750907] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-473d98b1-ea12-43f6-8749-401a513b928c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.751137] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-473d98b1-ea12-43f6-8749-401a513b928c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.751314] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('473d98b1-ea12-43f6-8749-401a513b928c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.752098] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e1bf27f4-91cf-44a6-8115-e3876163a888 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.752235] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.752294] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.752441] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.752513] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e1bf27f4-91cf-44a6-8115-e3876163a888',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.753254] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b132ea78-a4b4-47a2-98dc-0d195c085bca taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.753500] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b132ea78-a4b4-47a2-98dc-0d195c085bca" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.753563] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b132ea78-a4b4-47a2-98dc-0d195c085bca" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.753719] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b132ea78-a4b4-47a2-98dc-0d195c085bca" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.753799] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b132ea78-a4b4-47a2-98dc-0d195c085bca',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.754541] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66f4c424-4062-4ad5-867d-4d48776176cd taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.754710] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66f4c424-4062-4ad5-867d-4d48776176cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.754801] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66f4c424-4062-4ad5-867d-4d48776176cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.754900] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66f4c424-4062-4ad5-867d-4d48776176cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.754989] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66f4c424-4062-4ad5-867d-4d48776176cd',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.756275] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.756395] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.756395] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.756522] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.756610] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.757712] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ccb27bcf-56d8-49d9-af51-9eb4b1211bce taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.757874] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ccb27bcf-56d8-49d9-af51-9eb4b1211bce" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.757952] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ccb27bcf-56d8-49d9-af51-9eb4b1211bce" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.758103] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ccb27bcf-56d8-49d9-af51-9eb4b1211bce" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.758157] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ccb27bcf-56d8-49d9-af51-9eb4b1211bce',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.763111] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-35146777-fd28-4ac7-b454-f7dd3fbb5846 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.763362] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.763419] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.763632] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.763729] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('35146777-fd28-4ac7-b454-f7dd3fbb5846',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.765085] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-38b4d382-6400-4588-b620-faecfba1fd64 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.765242] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.765455] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.765455] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.765572] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('38b4d382-6400-4588-b620-faecfba1fd64',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.766554] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1d35af8-d196-4dd3-b8df-9b98089c1606 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.766699] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1d35af8-d196-4dd3-b8df-9b98089c1606" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.766699] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1d35af8-d196-4dd3-b8df-9b98089c1606" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.766868] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1d35af8-d196-4dd3-b8df-9b98089c1606" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.766931] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1d35af8-d196-4dd3-b8df-9b98089c1606',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.768407] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-92cba5b3-76df-405c-acab-0f3155ce22e5 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.768583] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-92cba5b3-76df-405c-acab-0f3155ce22e5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.768653] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-92cba5b3-76df-405c-acab-0f3155ce22e5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.768822] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-92cba5b3-76df-405c-acab-0f3155ce22e5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.768915] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('92cba5b3-76df-405c-acab-0f3155ce22e5',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.769166] env[62842]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 766.770054] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-38065a18-23d4-472c-902b-3e37fa7fb4aa taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.770171] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-38065a18-23d4-472c-902b-3e37fa7fb4aa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.770236] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-38065a18-23d4-472c-902b-3e37fa7fb4aa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.770390] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-38065a18-23d4-472c-902b-3e37fa7fb4aa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.770495] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('38065a18-23d4-472c-902b-3e37fa7fb4aa',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.771756] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a92b1e9-7c4f-4a77-a09f-3ba0782fff02 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.771912] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a92b1e9-7c4f-4a77-a09f-3ba0782fff02" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.771993] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a92b1e9-7c4f-4a77-a09f-3ba0782fff02" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.772210] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a92b1e9-7c4f-4a77-a09f-3ba0782fff02" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.772210] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a92b1e9-7c4f-4a77-a09f-3ba0782fff02',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.776037] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb447582-c572-481b-befa-98a3dcf064c3 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.776037] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb447582-c572-481b-befa-98a3dcf064c3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.776037] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb447582-c572-481b-befa-98a3dcf064c3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.776037] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb447582-c572-481b-befa-98a3dcf064c3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.776037] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb447582-c572-481b-befa-98a3dcf064c3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.776037] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-82e532f4-b8b0-4a4a-affc-1ab5a63253cd taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.776037] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.776037] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.776037] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.776037] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('82e532f4-b8b0-4a4a-affc-1ab5a63253cd',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.776037] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.776037] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.776037] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.776885] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.776885] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.777066] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37227a37-3f98-483a-add1-7f595a53cc2b taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.777311] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37227a37-3f98-483a-add1-7f595a53cc2b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.777401] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37227a37-3f98-483a-add1-7f595a53cc2b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.777538] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37227a37-3f98-483a-add1-7f595a53cc2b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.777609] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37227a37-3f98-483a-add1-7f595a53cc2b',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.778635] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fe43e864-555f-4ea5-8841-d2bcacb15ecc taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.778635] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.778790] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.778830] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.778878] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fe43e864-555f-4ea5-8841-d2bcacb15ecc',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.780119] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a03224f-b75b-48a5-9e23-3ca50aabbb33 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.780535] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.780535] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.780535] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.780659] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a03224f-b75b-48a5-9e23-3ca50aabbb33',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.781760] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3f89b292-3278-4b67-9a1b-21e48a9ef380 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.781892] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3f89b292-3278-4b67-9a1b-21e48a9ef380" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.783179] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3f89b292-3278-4b67-9a1b-21e48a9ef380" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.783179] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3f89b292-3278-4b67-9a1b-21e48a9ef380" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.783179] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3f89b292-3278-4b67-9a1b-21e48a9ef380',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.783420] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b321faa1-947f-4c79-ac72-202730c0dcd1 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.783524] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b321faa1-947f-4c79-ac72-202730c0dcd1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.783624] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b321faa1-947f-4c79-ac72-202730c0dcd1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.783830] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b321faa1-947f-4c79-ac72-202730c0dcd1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.783927] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b321faa1-947f-4c79-ac72-202730c0dcd1',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.784256] env[62842]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 766.790676] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1bf27f4-91cf-44a6-8115-e3876163a888 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.790905] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.791158] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.791280] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.791501] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.791645] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.791708] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.791879] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.791967] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.792068] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.792171] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e1bf27f4-91cf-44a6-8115-e3876163a888',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.830962] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.830962] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.830962] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.830962] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.831427] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.831482] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.832818] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.832961] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.860645] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.860645] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 473d98b1-ea12-43f6-8749-401a513b928c is going to be deleted. [ 766.861464] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.861558] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.887144] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.887396] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b132ea78-a4b4-47a2-98dc-0d195c085bca is going to be deleted. [ 766.888324] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.888552] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.888651] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.890373] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 03708cfa-ea22-40d4-8c09-177242e076fa already deleted. [ 766.890373] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-03708cfa-ea22-40d4-8c09-177242e076fa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.892876] env[62842]: INFO networking_nsxv3.common.synchronization [req-f97f4fa8-a004-46a6-aaae-54434b80ab05 req-4b4a9700-2745-4fb0-9e4c-df1af6430356 tempest-ServerRescueTestJSONUnderV235-470641360 tempest-ServerRescueTestJSONUnderV235-470641360-project-member] Enqueued Resource ID: 4e2d19a0-11e1-464b-a466-4822ce34ca16 with Priority: HIGHEST for action security_group_members [ 766.893052] env[62842]: INFO networking_nsxv3.common.synchronization [req-f97f4fa8-a004-46a6-aaae-54434b80ab05 req-4b4a9700-2745-4fb0-9e4c-df1af6430356 tempest-ServerRescueTestJSONUnderV235-470641360 tempest-ServerRescueTestJSONUnderV235-470641360-project-member] Enqueued Resource ID: ad7e736c-cd94-4208-98d0-e27879459756 with Priority: HIGHEST for action security_group_members [ 766.893593] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e2d19a0-11e1-464b-a466-4822ce34ca16 with Priority: HIGHEST for action security_group_members [ 766.893755] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad7e736c-cd94-4208-98d0-e27879459756 with Priority: HIGHEST for action security_group_members [ 766.894878] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e2d19a0-11e1-464b-a466-4822ce34ca16 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.895050] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.895119] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.895280] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.895439] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.897587] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.897736] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.897939] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.898033] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.898144] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e2d19a0-11e1-464b-a466-4822ce34ca16',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.899802] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad7e736c-cd94-4208-98d0-e27879459756 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.899802] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad7e736c-cd94-4208-98d0-e27879459756" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.899802] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad7e736c-cd94-4208-98d0-e27879459756" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.900052] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad7e736c-cd94-4208-98d0-e27879459756" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.900773] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.900773] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.900773] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.900773] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.900773] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.900773] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad7e736c-cd94-4208-98d0-e27879459756',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.913024] env[62842]: INFO networking_nsxv3.common.synchronization [None req-569b1f2c-3cb5-4c8c-98a6-e53d76c38213 tempest-ServerActionsTestJSON-670456711 tempest-ServerActionsTestJSON-670456711-project-member] Enqueued Resource ID: 03708cfa-ea22-40d4-8c09-177242e076fa with Priority: HIGHEST for action security_group_rules [ 766.913024] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03708cfa-ea22-40d4-8c09-177242e076fa with Priority: HIGHEST for action security_group_rules [ 766.913638] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-03708cfa-ea22-40d4-8c09-177242e076fa taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.913935] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-03708cfa-ea22-40d4-8c09-177242e076fa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.914931] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-03708cfa-ea22-40d4-8c09-177242e076fa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.914931] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-03708cfa-ea22-40d4-8c09-177242e076fa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.914931] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('03708cfa-ea22-40d4-8c09-177242e076fa',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.929281] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.929281] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.929281] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.929281] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.929281] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.929281] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-473d98b1-ea12-43f6-8749-401a513b928c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.955727] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.955727] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.955727] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.955727] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.955727] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.955727] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b132ea78-a4b4-47a2-98dc-0d195c085bca" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.985708] env[62842]: INFO networking_nsxv3.common.synchronization [req-f97f4fa8-a004-46a6-aaae-54434b80ab05 req-4b4a9700-2745-4fb0-9e4c-df1af6430356 tempest-ServerRescueTestJSONUnderV235-470641360 tempest-ServerRescueTestJSONUnderV235-470641360-project-member] Enqueued Resource ID: 4e2d19a0-11e1-464b-a466-4822ce34ca16 with Priority: HIGHEST for action security_group_rules [ 766.985965] env[62842]: INFO networking_nsxv3.common.synchronization [req-f97f4fa8-a004-46a6-aaae-54434b80ab05 req-4b4a9700-2745-4fb0-9e4c-df1af6430356 tempest-ServerRescueTestJSONUnderV235-470641360 tempest-ServerRescueTestJSONUnderV235-470641360-project-member] Enqueued Resource ID: 4e2d19a0-11e1-464b-a466-4822ce34ca16 with Priority: HIGHEST for action security_group_members [ 766.986567] env[62842]: INFO networking_nsxv3.common.synchronization [req-f97f4fa8-a004-46a6-aaae-54434b80ab05 req-4b4a9700-2745-4fb0-9e4c-df1af6430356 tempest-ServerRescueTestJSONUnderV235-470641360 tempest-ServerRescueTestJSONUnderV235-470641360-project-member] Enqueued Resource ID: ad7e736c-cd94-4208-98d0-e27879459756 with Priority: HIGHEST for action security_group_rules [ 766.986852] env[62842]: INFO networking_nsxv3.common.synchronization [req-f97f4fa8-a004-46a6-aaae-54434b80ab05 req-4b4a9700-2745-4fb0-9e4c-df1af6430356 tempest-ServerRescueTestJSONUnderV235-470641360 tempest-ServerRescueTestJSONUnderV235-470641360-project-member] Enqueued Resource ID: ad7e736c-cd94-4208-98d0-e27879459756 with Priority: HIGHEST for action security_group_members [ 766.986924] env[62842]: INFO networking_nsxv3.common.synchronization [req-f97f4fa8-a004-46a6-aaae-54434b80ab05 req-4b4a9700-2745-4fb0-9e4c-df1af6430356 tempest-ServerRescueTestJSONUnderV235-470641360 tempest-ServerRescueTestJSONUnderV235-470641360-project-member] Enqueued Resource ID: d16cb94e-a1ad-447d-88c7-b7b982b83b38 with Priority: HIGHEST for action port [ 766.987755] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e2d19a0-11e1-464b-a466-4822ce34ca16 with Priority: HIGHEST for action security_group_rules [ 766.987906] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad7e736c-cd94-4208-98d0-e27879459756 with Priority: HIGHEST for action security_group_rules [ 766.988012] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d16cb94e-a1ad-447d-88c7-b7b982b83b38 with Priority: HIGHEST for action port [ 766.988110] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e2d19a0-11e1-464b-a466-4822ce34ca16 with Priority: HIGHEST for action security_group_members [ 766.988200] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad7e736c-cd94-4208-98d0-e27879459756 with Priority: HIGHEST for action security_group_members [ 766.988497] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e2d19a0-11e1-464b-a466-4822ce34ca16 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.988651] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.988691] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.988890] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.989028] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e2d19a0-11e1-464b-a466-4822ce34ca16',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.990038] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad7e736c-cd94-4208-98d0-e27879459756 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.990163] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad7e736c-cd94-4208-98d0-e27879459756" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.990305] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad7e736c-cd94-4208-98d0-e27879459756" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.990541] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad7e736c-cd94-4208-98d0-e27879459756" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.990616] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad7e736c-cd94-4208-98d0-e27879459756',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.992431] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-d16cb94e-a1ad-447d-88c7-b7b982b83b38 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.992566] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d16cb94e-a1ad-447d-88c7-b7b982b83b38" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.992628] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d16cb94e-a1ad-447d-88c7-b7b982b83b38" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.992814] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d16cb94e-a1ad-447d-88c7-b7b982b83b38" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.992926] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d16cb94e-a1ad-447d-88c7-b7b982b83b38',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.000809] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e2d19a0-11e1-464b-a466-4822ce34ca16 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.000809] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.000809] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad7e736c-cd94-4208-98d0-e27879459756 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.000809] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad7e736c-cd94-4208-98d0-e27879459756" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.042046] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a14df1d2-b3a6-4075-b15b-967892c37b7e in Status: SUCCESS [ 767.042046] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a14df1d2-b3a6-4075-b15b-967892c37b7e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.042046] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a14df1d2-b3a6-4075-b15b-967892c37b7e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.042305] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a14df1d2-b3a6-4075-b15b-967892c37b7e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.043555] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.043555] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.043555] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.043555] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.043555] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.043555] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a14df1d2-b3a6-4075-b15b-967892c37b7e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.043555] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a14df1d2-b3a6-4075-b15b-967892c37b7e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.056434] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e in Status: SUCCESS [ 767.056886] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.301249] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1bf27f4-91cf-44a6-8115-e3876163a888 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.301249] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.301249] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.301249] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.301249] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.301249] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.301249] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.301249] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.301249] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.301249] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.301249] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1bf27f4-91cf-44a6-8115-e3876163a888 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.301249] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.301249] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.301249] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.301249] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.301249] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.302263] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.302263] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.302263] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.302263] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.302263] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e1bf27f4-91cf-44a6-8115-e3876163a888',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.327033] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.327205] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.327300] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.327575] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.327787] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.327865] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.327941] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.328089] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.328179] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.328274] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.328355] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.335012] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.335254] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.335372] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.335729] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.336544] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.336544] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.336544] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.336544] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.336544] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.336859] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.337764] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.338325] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-92cba5b3-76df-405c-acab-0f3155ce22e5 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.338600] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92cba5b3-76df-405c-acab-0f3155ce22e5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.338600] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92cba5b3-76df-405c-acab-0f3155ce22e5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.338805] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92cba5b3-76df-405c-acab-0f3155ce22e5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.339008] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.339175] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.339275] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.340041] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.340637] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.340637] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92cba5b3-76df-405c-acab-0f3155ce22e5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.340637] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('92cba5b3-76df-405c-acab-0f3155ce22e5',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.341544] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a03224f-b75b-48a5-9e23-3ca50aabbb33 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.342204] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.342327] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.342816] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.342816] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.342816] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.342988] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.344168] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.344168] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.344168] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.344168] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0a03224f-b75b-48a5-9e23-3ca50aabbb33',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.353698] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1d35af8-d196-4dd3-b8df-9b98089c1606 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.353952] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1d35af8-d196-4dd3-b8df-9b98089c1606" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.354513] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1d35af8-d196-4dd3-b8df-9b98089c1606" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.354886] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1d35af8-d196-4dd3-b8df-9b98089c1606" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.355316] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.355551] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.356021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.356021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.356319] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.356319] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1d35af8-d196-4dd3-b8df-9b98089c1606" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.356523] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d1d35af8-d196-4dd3-b8df-9b98089c1606',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.361743] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-38b4d382-6400-4588-b620-faecfba1fd64 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.361998] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.362178] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.362493] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.362803] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.363013] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.363163] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.363433] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.364227] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.364415] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.364610] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('38b4d382-6400-4588-b620-faecfba1fd64',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.370941] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb447582-c572-481b-befa-98a3dcf064c3 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.371167] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb447582-c572-481b-befa-98a3dcf064c3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.371597] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb447582-c572-481b-befa-98a3dcf064c3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.372299] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb447582-c572-481b-befa-98a3dcf064c3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.372299] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.372299] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.372299] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.372564] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.372785] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.372988] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb447582-c572-481b-befa-98a3dcf064c3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.373194] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eb447582-c572-481b-befa-98a3dcf064c3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.382224] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d1d35af8-d196-4dd3-b8df-9b98089c1606',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.383455] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-38b4d382-6400-4588-b620-faecfba1fd64 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.383657] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.383796] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.384054] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.384296] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.384452] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.384588] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.384787] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.384939] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.385543] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.385543] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-38b4d382-6400-4588-b620-faecfba1fd64 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.385543] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.385543] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.385543] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.385818] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.385818] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.385894] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.386097] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.386284] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.386420] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.386553] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('38b4d382-6400-4588-b620-faecfba1fd64',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.398225] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d1d35af8-d196-4dd3-b8df-9b98089c1606: rpc.has_security_group_logging(os_id): False [ 767.403983] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.404414] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.404414] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.404567] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.408300] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.408493] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.411650] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.411650] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.420273] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e2d19a0-11e1-464b-a466-4822ce34ca16',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.421392] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ad7e736c-cd94-4208-98d0-e27879459756',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.426561] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.426763] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.433954] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.434216] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.436331] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.436331] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.437106] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.437192] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.438211] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.438365] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.439040] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.439139] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.444832] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.444944] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.446361] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.446471] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.447536] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.447536] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.448956] env[62842]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 767.449471] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.449661] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66f4c424-4062-4ad5-867d-4d48776176cd is going to be deleted. [ 767.450558] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.450800] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.472168] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.472301] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fe43e864-555f-4ea5-8841-d2bcacb15ecc is going to be deleted. [ 767.473282] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.473513] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.493155] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.493312] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 38065a18-23d4-472c-902b-3e37fa7fb4aa is going to be deleted. [ 767.494296] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.494526] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.498504] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad7e736c-cd94-4208-98d0-e27879459756 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.498632] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad7e736c-cd94-4208-98d0-e27879459756" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.498843] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e2d19a0-11e1-464b-a466-4822ce34ca16 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.498933] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.499077] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d16cb94e-a1ad-447d-88c7-b7b982b83b38 with status ACTIVE [ 767.499227] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.499327] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.499386] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.499627] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.499715] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.499885] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.499995] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.500182] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.500250] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.500300] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.500462] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.500560] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.500610] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.500737] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.500803] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.500883] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d16cb94e-a1ad-447d-88c7-b7b982b83b38 is going to be updated. [ 767.543683] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.543846] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.545681] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-a14df1d2-b3a6-4075-b15b-967892c37b7e taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.545681] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a14df1d2-b3a6-4075-b15b-967892c37b7e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.545681] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a14df1d2-b3a6-4075-b15b-967892c37b7e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.545846] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a14df1d2-b3a6-4075-b15b-967892c37b7e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.546015] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.546110] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.546169] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.546322] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.546413] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.546547] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a14df1d2-b3a6-4075-b15b-967892c37b7e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.546713] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-a14df1d2-b3a6-4075-b15b-967892c37b7e taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.546807] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a14df1d2-b3a6-4075-b15b-967892c37b7e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.546807] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a14df1d2-b3a6-4075-b15b-967892c37b7e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.548047] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a14df1d2-b3a6-4075-b15b-967892c37b7e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.548047] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.548047] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.548047] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.548047] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.548047] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.548047] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a14df1d2-b3a6-4075-b15b-967892c37b7e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.548047] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a14df1d2-b3a6-4075-b15b-967892c37b7e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.549490] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.549658] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.549968] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.549968] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.549968] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.550910] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d16cb94e-a1ad-447d-88c7-b7b982b83b38" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.552460] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.552460] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.554749] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.554749] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a92b1e9-7c4f-4a77-a09f-3ba0782fff02 is going to be deleted. [ 767.555529] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.555832] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.588778] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.588977] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37227a37-3f98-483a-add1-7f595a53cc2b is going to be deleted. [ 767.589943] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.590159] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.603529] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.603801] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.612471] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.612653] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd is going to be deleted. [ 767.618045] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.618467] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.692560] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.692860] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.693710] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.693851] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b321faa1-947f-4c79-ac72-202730c0dcd1 is going to be deleted. [ 767.694757] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.695978] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.697135] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.697293] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.759991] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.760110] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ccb27bcf-56d8-49d9-af51-9eb4b1211bce is going to be deleted. [ 767.764023] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.764023] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.803605] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.803605] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3f89b292-3278-4b67-9a1b-21e48a9ef380 is going to be deleted. [ 767.804741] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e1bf27f4-91cf-44a6-8115-e3876163a888: rpc.has_security_group_logging(os_id): False [ 767.806234] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.806363] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.806458] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.806560] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 03708cfa-ea22-40d4-8c09-177242e076fa already deleted. [ 767.806644] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-03708cfa-ea22-40d4-8c09-177242e076fa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.806842] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.807057] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.812017] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.812191] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.833271] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.845372] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0a03224f-b75b-48a5-9e23-3ca50aabbb33',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.851369] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('92cba5b3-76df-405c-acab-0f3155ce22e5',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.853397] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.870908] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.872187] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.880923] env[62842]: INFO networking_nsxv3.common.synchronization [req-2ac26b01-7375-4cd3-ad4e-2c92342cb874 req-596cd898-e752-4340-891d-45085f77a463 tempest-ServersTestBootFromVolume-595571146 tempest-ServersTestBootFromVolume-595571146-project-member] Enqueued Resource ID: d1d35af8-d196-4dd3-b8df-9b98089c1606 with Priority: HIGHEST for action security_group_members [ 767.881518] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1d35af8-d196-4dd3-b8df-9b98089c1606 with Priority: HIGHEST for action security_group_members [ 767.881715] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1d35af8-d196-4dd3-b8df-9b98089c1606 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.881784] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1d35af8-d196-4dd3-b8df-9b98089c1606" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.881908] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1d35af8-d196-4dd3-b8df-9b98089c1606" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.882076] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1d35af8-d196-4dd3-b8df-9b98089c1606" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.882237] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.882525] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.882525] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.882697] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.882781] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.882877] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1d35af8-d196-4dd3-b8df-9b98089c1606',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.890918] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eb447582-c572-481b-befa-98a3dcf064c3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.898129] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 38b4d382-6400-4588-b620-faecfba1fd64: rpc.has_security_group_logging(os_id): False [ 767.900986] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.901146] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.901226] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.901294] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.901499] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.901584] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.901680] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1d35af8-d196-4dd3-b8df-9b98089c1606 is going to be updated. [ 767.902743] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.903625] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.917633] env[62842]: INFO networking_nsxv3.common.synchronization [req-53c1cee5-f7d4-4ff5-8420-710afe192570 req-0c15cc4a-f4cc-4a9b-b27b-aabcf8655d19 tempest-ServerRescueTestJSONUnderV235-470641360 tempest-ServerRescueTestJSONUnderV235-470641360-project-member] Enqueued Resource ID: 4e2d19a0-11e1-464b-a466-4822ce34ca16 with Priority: HIGHEST for action security_group_members [ 767.917811] env[62842]: INFO networking_nsxv3.common.synchronization [req-53c1cee5-f7d4-4ff5-8420-710afe192570 req-0c15cc4a-f4cc-4a9b-b27b-aabcf8655d19 tempest-ServerRescueTestJSONUnderV235-470641360 tempest-ServerRescueTestJSONUnderV235-470641360-project-member] Enqueued Resource ID: ad7e736c-cd94-4208-98d0-e27879459756 with Priority: HIGHEST for action security_group_members [ 767.918394] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e2d19a0-11e1-464b-a466-4822ce34ca16 with Priority: HIGHEST for action security_group_members [ 767.918454] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad7e736c-cd94-4208-98d0-e27879459756 with Priority: HIGHEST for action security_group_members [ 767.918838] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e2d19a0-11e1-464b-a466-4822ce34ca16 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.918979] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.919205] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad7e736c-cd94-4208-98d0-e27879459756 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.919299] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad7e736c-cd94-4208-98d0-e27879459756" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.924437] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e2d19a0-11e1-464b-a466-4822ce34ca16',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.928942] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ad7e736c-cd94-4208-98d0-e27879459756',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.963294] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.963493] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.968818] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.969012] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.985686] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.985919] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.986849] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.986964] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.001998] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.002180] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 is going to be deleted. [ 768.003323] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.003589] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.004673] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.004673] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fe43e864-555f-4ea5-8841-d2bcacb15ecc" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.005138] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.005450] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.005536] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.005664] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-38065a18-23d4-472c-902b-3e37fa7fb4aa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.006289] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.006541] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.006632] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.007295] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a92b1e9-7c4f-4a77-a09f-3ba0782fff02" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.007566] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.008011] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.008443] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.008596] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37227a37-3f98-483a-add1-7f595a53cc2b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.008754] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.008919] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.009038] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.009128] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.009260] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.009462] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.052103] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a14df1d2-b3a6-4075-b15b-967892c37b7e: rpc.has_security_group_logging(os_id): False [ 768.075428] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.075747] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.075990] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.076089] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.076849] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.076849] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.076849] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.076849] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.076849] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.076849] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.077176] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.077176] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.077261] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.077261] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.077415] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.077998] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.077998] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e1bf27f4-91cf-44a6-8115-e3876163a888 is going to be updated. [ 768.079031] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.079200] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.079288] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.079431] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66f4c424-4062-4ad5-867d-4d48776176cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.079618] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.079767] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.079842] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.079965] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b321faa1-947f-4c79-ac72-202730c0dcd1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.080982] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.081157] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.081239] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.081349] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ccb27bcf-56d8-49d9-af51-9eb4b1211bce" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.081467] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.081655] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.081807] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.081925] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3f89b292-3278-4b67-9a1b-21e48a9ef380" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.083296] env[62842]: INFO networking_nsxv3.common.synchronization [req-53c1cee5-f7d4-4ff5-8420-710afe192570 req-0c15cc4a-f4cc-4a9b-b27b-aabcf8655d19 tempest-ServerRescueTestJSONUnderV235-470641360 tempest-ServerRescueTestJSONUnderV235-470641360-project-member] Enqueued Resource ID: 4e2d19a0-11e1-464b-a466-4822ce34ca16 with Priority: HIGHEST for action security_group_rules [ 768.083509] env[62842]: INFO networking_nsxv3.common.synchronization [req-53c1cee5-f7d4-4ff5-8420-710afe192570 req-0c15cc4a-f4cc-4a9b-b27b-aabcf8655d19 tempest-ServerRescueTestJSONUnderV235-470641360 tempest-ServerRescueTestJSONUnderV235-470641360-project-member] Enqueued Resource ID: 4e2d19a0-11e1-464b-a466-4822ce34ca16 with Priority: HIGHEST for action security_group_members [ 768.083699] env[62842]: INFO networking_nsxv3.common.synchronization [req-53c1cee5-f7d4-4ff5-8420-710afe192570 req-0c15cc4a-f4cc-4a9b-b27b-aabcf8655d19 tempest-ServerRescueTestJSONUnderV235-470641360 tempest-ServerRescueTestJSONUnderV235-470641360-project-member] Enqueued Resource ID: d16cb94e-a1ad-447d-88c7-b7b982b83b38 with Priority: HIGHEST for action port [ 768.083905] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.084105] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.085927] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e2d19a0-11e1-464b-a466-4822ce34ca16 with Priority: HIGHEST for action security_group_rules [ 768.085927] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e2d19a0-11e1-464b-a466-4822ce34ca16 with Priority: HIGHEST for action security_group_members [ 768.085927] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d16cb94e-a1ad-447d-88c7-b7b982b83b38 with Priority: HIGHEST for action port [ 768.086389] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e2d19a0-11e1-464b-a466-4822ce34ca16 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.086489] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.086704] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e2d19a0-11e1-464b-a466-4822ce34ca16 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.086785] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.086958] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-d16cb94e-a1ad-447d-88c7-b7b982b83b38 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.087069] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d16cb94e-a1ad-447d-88c7-b7b982b83b38" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.087132] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d16cb94e-a1ad-447d-88c7-b7b982b83b38" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.087289] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d16cb94e-a1ad-447d-88c7-b7b982b83b38" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.087367] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d16cb94e-a1ad-447d-88c7-b7b982b83b38',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.096896] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.097154] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.107365] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.107490] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.134640] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.135024] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.135145] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.135145] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.135371] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.135913] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.135913] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.135913] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.135913] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.136188] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.136188] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.136275] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.136335] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.136398] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.136576] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.136676] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.136778] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 38b4d382-6400-4588-b620-faecfba1fd64 is going to be updated. [ 768.137989] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.138200] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.138288] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.138480] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.138581] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.138640] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.138781] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.138856] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.139041] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.139137] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.139195] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.139458] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.139562] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.139762] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.139850] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.139905] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.140068] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.140140] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.140204] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a14df1d2-b3a6-4075-b15b-967892c37b7e is going to be created. [ 768.141317] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.141480] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.141627] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.148182] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.148392] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.148392] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.148592] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.148692] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.148813] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.168164] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d1d35af8-d196-4dd3-b8df-9b98089c1606 in Status: IN_PROGRESS for 2s [ 768.258937] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.259105] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.259171] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.263026] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.263026] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.308917] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e1bf27f4-91cf-44a6-8115-e3876163a888 in Status: IN_PROGRESS for 2s [ 768.318700] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.318899] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.318973] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.321713] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.321713] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.324061] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.324206] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.324385] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.324470] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.324966] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.335893] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55: rpc.has_security_group_logging(os_id): False [ 768.347673] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0a03224f-b75b-48a5-9e23-3ca50aabbb33: rpc.has_security_group_logging(os_id): False [ 768.355785] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a14df1d2-b3a6-4075-b15b-967892c37b7e in Status: IN_PROGRESS for 2s [ 768.355785] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 92cba5b3-76df-405c-acab-0f3155ce22e5: rpc.has_security_group_logging(os_id): False [ 768.355785] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393: rpc.has_security_group_logging(os_id): False [ 768.356988] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 38b4d382-6400-4588-b620-faecfba1fd64 in Status: IN_PROGRESS for 2s [ 768.379303] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.379303] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.379303] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.379303] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.385262] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.385262] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.385262] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.385262] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.386917] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.387391] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.389458] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.389458] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.397595] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eb447582-c572-481b-befa-98a3dcf064c3: rpc.has_security_group_logging(os_id): False [ 768.422544] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.425125] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.425336] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.425417] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.425683] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.425786] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.425925] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 is going to be updated. [ 768.427172] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.427385] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.428647] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.428789] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.428865] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.429060] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.429456] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.429456] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e2d19a0-11e1-464b-a466-4822ce34ca16 is going to be updated. [ 768.431864] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.431864] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.431864] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.431864] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.431864] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.432102] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad7e736c-cd94-4208-98d0-e27879459756 is going to be created. [ 768.449678] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.449678] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.488764] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.489117] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.489236] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.489723] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.489723] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.489723] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.489884] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55 is going to be updated. [ 768.491937] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.492040] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.517568] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.517568] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.517568] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.517568] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.517568] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.557338] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad7e736c-cd94-4208-98d0-e27879459756 in Status: UNINITIALIZED for 2s [ 768.561508] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.562678] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.562678] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.562678] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.562678] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.563015] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.563015] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 is going to be updated. [ 768.564678] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.564839] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.564988] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.565370] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.565500] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.565606] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.565835] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.566018] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.566157] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1d35af8-d196-4dd3-b8df-9b98089c1606 is going to be updated. [ 768.567689] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.567907] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.571678] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.571887] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.571957] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.573018] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.573018] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.590780] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d16cb94e-a1ad-447d-88c7-b7b982b83b38 with status ACTIVE [ 768.592135] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.592135] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.592135] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.592135] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.592135] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.592135] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.592135] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.592135] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.592515] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.592515] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.592515] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.592515] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.592649] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.592744] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.592782] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.592883] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d16cb94e-a1ad-447d-88c7-b7b982b83b38 is going to be updated. [ 768.604575] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e2d19a0-11e1-464b-a466-4822ce34ca16 in Status: IN_PROGRESS for 2s [ 768.618152] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.618152] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.618152] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.618152] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.618152] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.618152] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.618398] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb447582-c572-481b-befa-98a3dcf064c3 is going to be updated. [ 768.619373] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.619586] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.632078] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.632171] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.632171] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.632419] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.632553] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.632722] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d16cb94e-a1ad-447d-88c7-b7b982b83b38" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.639024] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.639197] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.639249] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.639467] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.639631] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.650681] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1d35af8-d196-4dd3-b8df-9b98089c1606 in Status: IN_PROGRESS for 2s [ 768.651683] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.651994] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.652127] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.652190] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.652383] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.652461] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.652547] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 92cba5b3-76df-405c-acab-0f3155ce22e5 is going to be updated. [ 768.709266] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.709468] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.709538] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.709759] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.709922] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.714794] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.715013] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.715106] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.715378] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.715593] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.718361] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.718521] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.718587] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.718799] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.718948] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.750047] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.750275] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.750275] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.752354] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.752354] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.757238] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55 in Status: IN_PROGRESS for 2s [ 768.760233] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 in Status: IN_PROGRESS for 2s [ 768.762718] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 in Status: IN_PROGRESS for 2s [ 768.820453] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb447582-c572-481b-befa-98a3dcf064c3 in Status: IN_PROGRESS for 2s [ 768.821548] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.821780] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.821856] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.822216] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.822299] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.859129] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 92cba5b3-76df-405c-acab-0f3155ce22e5 in Status: IN_PROGRESS for 2s [ 770.182685] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d1d35af8-d196-4dd3-b8df-9b98089c1606 in Status: SUCCESS [ 770.182685] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1d35af8-d196-4dd3-b8df-9b98089c1606" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.326663] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e1bf27f4-91cf-44a6-8115-e3876163a888 in Status: SUCCESS [ 770.326663] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.369331] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a14df1d2-b3a6-4075-b15b-967892c37b7e in Status: SUCCESS [ 770.369666] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a14df1d2-b3a6-4075-b15b-967892c37b7e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.370834] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 38b4d382-6400-4588-b620-faecfba1fd64 in Status: SUCCESS [ 770.371042] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.569282] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad7e736c-cd94-4208-98d0-e27879459756 in Status: SUCCESS [ 770.569530] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad7e736c-cd94-4208-98d0-e27879459756" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.569659] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad7e736c-cd94-4208-98d0-e27879459756" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.571163] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad7e736c-cd94-4208-98d0-e27879459756" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.571408] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.571558] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.571695] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.571907] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.572015] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.572119] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad7e736c-cd94-4208-98d0-e27879459756',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.615578] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e2d19a0-11e1-464b-a466-4822ce34ca16 in Status: SUCCESS [ 770.615772] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.615990] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.616201] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.616418] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.616500] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.616565] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.616714] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.616801] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.616892] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e2d19a0-11e1-464b-a466-4822ce34ca16',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.661473] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1d35af8-d196-4dd3-b8df-9b98089c1606 in Status: SUCCESS [ 770.661743] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1d35af8-d196-4dd3-b8df-9b98089c1606 deletion is rescheduled due to dependency. [ 770.661825] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1d35af8-d196-4dd3-b8df-9b98089c1606" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.776125] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55 in Status: SUCCESS [ 770.776125] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.779725] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 in Status: SUCCESS [ 770.782046] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.782046] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 in Status: SUCCESS [ 770.782046] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.835029] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb447582-c572-481b-befa-98a3dcf064c3 in Status: SUCCESS [ 770.835029] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb447582-c572-481b-befa-98a3dcf064c3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.874660] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 92cba5b3-76df-405c-acab-0f3155ce22e5 in Status: SUCCESS [ 770.874896] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-92cba5b3-76df-405c-acab-0f3155ce22e5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.079219] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.079219] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.079219] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.079219] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.079219] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.079219] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.079219] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.079219] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.079219] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.079219] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.079219] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad7e736c-cd94-4208-98d0-e27879459756 is going to be deleted. [ 771.112946] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.113732] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.113830] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.114147] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.114147] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.114266] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad7e736c-cd94-4208-98d0-e27879459756" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.114759] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad7e736c-cd94-4208-98d0-e27879459756" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.114759] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad7e736c-cd94-4208-98d0-e27879459756" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.114759] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.114985] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.114985] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.114985] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.116223] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.116223] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad7e736c-cd94-4208-98d0-e27879459756',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.123010] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e2d19a0-11e1-464b-a466-4822ce34ca16',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.619326] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.623289] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.623289] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.623289] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.623289] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.623289] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.623289] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.623289] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.623289] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.623289] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.623289] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad7e736c-cd94-4208-98d0-e27879459756 already deleted. [ 771.623289] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad7e736c-cd94-4208-98d0-e27879459756" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.623289] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ad7e736c-cd94-4208-98d0-e27879459756',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.623289] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad7e736c-cd94-4208-98d0-e27879459756" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.624512] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad7e736c-cd94-4208-98d0-e27879459756" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.625081] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.625453] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.626355] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.626355] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.626355] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.626355] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad7e736c-cd94-4208-98d0-e27879459756',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.629298] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e2d19a0-11e1-464b-a466-4822ce34ca16',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.131747] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ad7e736c-cd94-4208-98d0-e27879459756',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.131747] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.131747] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.131747] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.131747] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.131747] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.131747] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.131747] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.131747] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.131747] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.131747] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.131747] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad7e736c-cd94-4208-98d0-e27879459756 already deleted. [ 772.131747] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad7e736c-cd94-4208-98d0-e27879459756" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.131747] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.131747] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.131747] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.137229] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.137229] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.137229] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e2d19a0-11e1-464b-a466-4822ce34ca16 is going to be updated. [ 772.167776] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.167776] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.167776] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.167776] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.167776] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.179052] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e2d19a0-11e1-464b-a466-4822ce34ca16 in Status: IN_PROGRESS for 2s [ 772.639136] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ad7e736c-cd94-4208-98d0-e27879459756: rpc.has_security_group_logging(os_id): False [ 772.657675] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.657675] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.657675] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.657675] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.657675] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.657675] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.657675] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.657675] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.657675] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.657675] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.657675] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad7e736c-cd94-4208-98d0-e27879459756 is going to be created. [ 772.677736] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/ad7e736c-cd94-4208-98d0-e27879459756], does not exist path=[/infra/domains/default/groups/ad7e736c-cd94-4208-98d0-e27879459756]."\n}' [ 772.679478] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad7e736c-cd94-4208-98d0-e27879459756 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/ad7e736c-cd94-4208-98d0-e27879459756 [ 772.681733] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 772.719170] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.719170] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.719170] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.719170] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.719170] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.719170] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.719170] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.719628] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.719908] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.720250] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.720601] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.720827] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.720976] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.721413] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.721596] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.721798] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad7e736c-cd94-4208-98d0-e27879459756 is going to be created. [ 772.763380] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/ad7e736c-cd94-4208-98d0-e27879459756], does not exist path=[/infra/domains/default/groups/ad7e736c-cd94-4208-98d0-e27879459756]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/ad7e736c-cd94-4208-98d0-e27879459756 [ 772.763380] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad7e736c-cd94-4208-98d0-e27879459756" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.763380] env[62842]: Traceback (most recent call last): [ 772.763380] env[62842]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 772.763380] env[62842]: return func(*args, **kwargs) [ 772.763380] env[62842]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 772.763380] env[62842]: res.raise_for_status() [ 772.763380] env[62842]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 772.763380] env[62842]: raise HTTPError(http_error_msg, response=self) [ 772.763380] env[62842]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/ad7e736c-cd94-4208-98d0-e27879459756 [ 772.763380] env[62842]: During handling of the above exception, another exception occurred: [ 772.763380] env[62842]: Traceback (most recent call last): [ 772.763380] env[62842]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 772.763380] env[62842]: listener.cb(fileno) [ 772.763380] env[62842]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 772.763380] env[62842]: result = function(*args, **kwargs) [ 772.763380] env[62842]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 772.763380] env[62842]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 772.763380] env[62842]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 772.763380] env[62842]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 772.763380] env[62842]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 772.763380] env[62842]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 772.763380] env[62842]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 772.763380] env[62842]: res.raise_for_status() [ 772.763380] env[62842]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 772.763380] env[62842]: raise HTTPError(http_error_msg, response=self) [ 772.763380] env[62842]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/ad7e736c-cd94-4208-98d0-e27879459756 [ 772.763380] env[62842]: Removing descriptor: 67 [ 773.087022] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 773.087232] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=5 [ 773.738097] env[62842]: INFO networking_nsxv3.common.synchronization [None req-46a76ddf-ac12-4712-b73b-612610935f80 tempest-ImagesOneServerNegativeTestJSON-864549307 tempest-ImagesOneServerNegativeTestJSON-864549307-project-member] Enqueued Resource ID: f36d0723-8863-42a0-a028-6fd04d852e81 with Priority: HIGHEST for action security_group_rules [ 773.738097] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f36d0723-8863-42a0-a028-6fd04d852e81 with Priority: HIGHEST for action security_group_rules [ 773.738595] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f36d0723-8863-42a0-a028-6fd04d852e81 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.738595] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f36d0723-8863-42a0-a028-6fd04d852e81" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.738595] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f36d0723-8863-42a0-a028-6fd04d852e81" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.738932] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f36d0723-8863-42a0-a028-6fd04d852e81" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.738932] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f36d0723-8863-42a0-a028-6fd04d852e81',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.884431] env[62842]: INFO networking_nsxv3.common.synchronization [None req-b0634895-5a5d-422f-8ce1-dd4f80b664b1 tempest-ImagesOneServerNegativeTestJSON-864549307 tempest-ImagesOneServerNegativeTestJSON-864549307-project-member] Enqueued Resource ID: f36d0723-8863-42a0-a028-6fd04d852e81 with Priority: HIGHEST for action security_group_rules [ 773.886165] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f36d0723-8863-42a0-a028-6fd04d852e81 with Priority: HIGHEST for action security_group_rules [ 773.886165] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f36d0723-8863-42a0-a028-6fd04d852e81 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.886165] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f36d0723-8863-42a0-a028-6fd04d852e81" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.190795] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e2d19a0-11e1-464b-a466-4822ce34ca16 in Status: SUCCESS [ 774.191028] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.191200] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.191428] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.191688] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.191803] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.191803] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.191972] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.192066] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.192153] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.192251] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4e2d19a0-11e1-464b-a466-4822ce34ca16',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.198047] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.198047] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.198047] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.198047] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.198047] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.198047] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.198047] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.198047] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e2d19a0-11e1-464b-a466-4822ce34ca16',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.260710] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.260935] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.261010] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.261185] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.261273] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.261365] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f36d0723-8863-42a0-a028-6fd04d852e81 already deleted. [ 774.261445] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f36d0723-8863-42a0-a028-6fd04d852e81" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.262027] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f36d0723-8863-42a0-a028-6fd04d852e81" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.262027] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f36d0723-8863-42a0-a028-6fd04d852e81" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.262027] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f36d0723-8863-42a0-a028-6fd04d852e81',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.701398] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e2d19a0-11e1-464b-a466-4822ce34ca16 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.702146] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.702582] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e2d19a0-11e1-464b-a466-4822ce34ca16',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.784640] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.784966] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.784966] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.785159] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.785159] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.785454] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f36d0723-8863-42a0-a028-6fd04d852e81 already deleted. [ 774.785454] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f36d0723-8863-42a0-a028-6fd04d852e81" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.211221] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e2d19a0-11e1-464b-a466-4822ce34ca16',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.615773] env[62842]: INFO networking_nsxv3.common.synchronization [None req-706245e0-6c0c-4f75-99c8-330ff41be6ef None None] Enqueued Resource ID: 92130026-968a-4485-b409-5234ee4f8ba3 with Priority: HIGHEST for action port [ 775.616719] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92130026-968a-4485-b409-5234ee4f8ba3 with Priority: HIGHEST for action port [ 775.617620] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-92130026-968a-4485-b409-5234ee4f8ba3 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.618477] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92130026-968a-4485-b409-5234ee4f8ba3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.618477] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92130026-968a-4485-b409-5234ee4f8ba3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.618477] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92130026-968a-4485-b409-5234ee4f8ba3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.618477] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92130026-968a-4485-b409-5234ee4f8ba3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.713578] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.713841] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.713841] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.714181] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.714291] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.714403] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e2d19a0-11e1-464b-a466-4822ce34ca16 is going to be updated. [ 775.756802] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.756802] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.756802] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.756802] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.756802] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.774025] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e2d19a0-11e1-464b-a466-4822ce34ca16 in Status: IN_PROGRESS for 2s [ 776.120694] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 92130026-968a-4485-b409-5234ee4f8ba3 [ 776.120694] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.120694] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.120694] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.121694] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.121694] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.121694] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:92130026-968a-4485-b409-5234ee4f8ba3 already deleted. [ 776.121694] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92130026-968a-4485-b409-5234ee4f8ba3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.837089] env[62842]: INFO networking_nsxv3.common.synchronization [None req-af96e9e7-7bdf-4a0f-910b-4b03bdfdca72 tempest-AttachInterfacesUnderV243Test-764117880 tempest-AttachInterfacesUnderV243Test-764117880-project-member] Enqueued Resource ID: 83478649-c10f-45af-9cd9-d412883cd575 with Priority: HIGHEST for action security_group_rules [ 776.837629] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83478649-c10f-45af-9cd9-d412883cd575 with Priority: HIGHEST for action security_group_rules [ 776.837948] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-83478649-c10f-45af-9cd9-d412883cd575 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.839138] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-83478649-c10f-45af-9cd9-d412883cd575" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.839138] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-83478649-c10f-45af-9cd9-d412883cd575" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.839284] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-83478649-c10f-45af-9cd9-d412883cd575" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.839384] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('83478649-c10f-45af-9cd9-d412883cd575',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.143201] env[62842]: INFO networking_nsxv3.common.synchronization [None req-f90a232c-003a-4203-a9ae-15ff84c3d665 tempest-AttachInterfacesUnderV243Test-764117880 tempest-AttachInterfacesUnderV243Test-764117880-project-member] Enqueued Resource ID: 83478649-c10f-45af-9cd9-d412883cd575 with Priority: HIGHEST for action security_group_rules [ 777.144507] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83478649-c10f-45af-9cd9-d412883cd575 with Priority: HIGHEST for action security_group_rules [ 777.145697] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-83478649-c10f-45af-9cd9-d412883cd575 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.145950] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-83478649-c10f-45af-9cd9-d412883cd575" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.217331] env[62842]: INFO networking_nsxv3.common.synchronization [req-71dd56b8-6863-482f-960c-17a1015108ad req-d6bb3d27-6a5f-47bf-9efe-66ab67405511 tempest-AttachVolumeTestJSON-43280943 tempest-AttachVolumeTestJSON-43280943-project-member] Enqueued Resource ID: c59f85b7-500a-400b-bef3-55b5e589248f with Priority: HIGHEST for action security_group_members [ 777.217331] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c59f85b7-500a-400b-bef3-55b5e589248f with Priority: HIGHEST for action security_group_members [ 777.217331] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-c59f85b7-500a-400b-bef3-55b5e589248f taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.217331] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c59f85b7-500a-400b-bef3-55b5e589248f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.217331] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c59f85b7-500a-400b-bef3-55b5e589248f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.217331] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c59f85b7-500a-400b-bef3-55b5e589248f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.217331] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.220672] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.221089] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.221695] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.221695] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.221695] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c59f85b7-500a-400b-bef3-55b5e589248f',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.368206] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.368206] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.368206] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.368206] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.368206] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.368206] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 83478649-c10f-45af-9cd9-d412883cd575 already deleted. [ 777.368630] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-83478649-c10f-45af-9cd9-d412883cd575" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.369771] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-83478649-c10f-45af-9cd9-d412883cd575" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.369983] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-83478649-c10f-45af-9cd9-d412883cd575" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.370093] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('83478649-c10f-45af-9cd9-d412883cd575',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.824184] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.824334] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.824334] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.824993] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.824993] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.824993] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.824993] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.824993] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.824993] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.825403] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.825403] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c59f85b7-500a-400b-bef3-55b5e589248f already deleted. [ 777.825403] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c59f85b7-500a-400b-bef3-55b5e589248f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.837540] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e2d19a0-11e1-464b-a466-4822ce34ca16 in Status: SUCCESS [ 777.837772] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.837934] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.838412] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.838607] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.838887] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.838887] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.839015] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.839015] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.839111] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e2d19a0-11e1-464b-a466-4822ce34ca16',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.842824] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-435 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.843022] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-435" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.843148] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-435" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.843447] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-435" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.844438] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.844438] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.844438] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.844438] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.844438] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.844754] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 777.844754] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 777.844933] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 777.844933] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 777.845049] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 777.845466] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 777.845466] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 777.870271] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 777.870587] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 777.870750] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 777.871025] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-435" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.871480] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-43a4a7e4-0cf1-4fed-ab3d-a311a1da6b33 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.871761] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-43a4a7e4-0cf1-4fed-ab3d-a311a1da6b33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.871843] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-43a4a7e4-0cf1-4fed-ab3d-a311a1da6b33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.872304] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-43a4a7e4-0cf1-4fed-ab3d-a311a1da6b33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.872480] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43a4a7e4-0cf1-4fed-ab3d-a311a1da6b33',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.893999] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.894174] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.894239] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.894471] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.895278] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.895278] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 83478649-c10f-45af-9cd9-d412883cd575 already deleted. [ 777.895278] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-83478649-c10f-45af-9cd9-d412883cd575" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.154556] env[62842]: INFO networking_nsxv3.common.synchronization [None req-8fa297db-3293-4aa2-bdcd-feb7dca496f6 None None] Enqueued Resource ID: 8b90fdfc-1ba7-4b93-a93c-2b8e1758faf0 with Priority: HIGHEST for action port [ 778.155553] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b90fdfc-1ba7-4b93-a93c-2b8e1758faf0 with Priority: HIGHEST for action port [ 778.155553] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-8b90fdfc-1ba7-4b93-a93c-2b8e1758faf0 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.155707] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8b90fdfc-1ba7-4b93-a93c-2b8e1758faf0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.155707] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8b90fdfc-1ba7-4b93-a93c-2b8e1758faf0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.155982] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8b90fdfc-1ba7-4b93-a93c-2b8e1758faf0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.156091] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b90fdfc-1ba7-4b93-a93c-2b8e1758faf0',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.341908] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e2d19a0-11e1-464b-a466-4822ce34ca16',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.377205] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.377417] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.377533] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.377826] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.377990] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.378158] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 43a4a7e4-0cf1-4fed-ab3d-a311a1da6b33 not found, creating... [ 778.378431] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.378621] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.378697] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.378931] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.379099] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.379369] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.379590] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.379747] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.379970] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.380865] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.381160] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 43a4a7e4-0cf1-4fed-ab3d-a311a1da6b33 is going to be created. [ 778.419423] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.419678] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.419852] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.420145] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.420475] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.420800] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-43a4a7e4-0cf1-4fed-ab3d-a311a1da6b33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.662375] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8b90fdfc-1ba7-4b93-a93c-2b8e1758faf0 [ 778.662375] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.662375] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.662665] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.662761] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.662897] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.663158] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8b90fdfc-1ba7-4b93-a93c-2b8e1758faf0 already deleted. [ 778.663158] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8b90fdfc-1ba7-4b93-a93c-2b8e1758faf0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.808976] env[62842]: INFO networking_nsxv3.common.synchronization [None req-33291d21-b023-4e17-b290-313ba58e62ce None None] Enqueued Resource ID: aa9ebb23-5905-49f2-8ee7-0bbf702efc94 with Priority: HIGHEST for action port [ 778.809368] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa9ebb23-5905-49f2-8ee7-0bbf702efc94 with Priority: HIGHEST for action port [ 778.810045] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa9ebb23-5905-49f2-8ee7-0bbf702efc94 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.810205] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa9ebb23-5905-49f2-8ee7-0bbf702efc94" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.811181] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa9ebb23-5905-49f2-8ee7-0bbf702efc94" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.811461] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa9ebb23-5905-49f2-8ee7-0bbf702efc94" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.811558] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa9ebb23-5905-49f2-8ee7-0bbf702efc94',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.847551] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e2d19a0-11e1-464b-a466-4822ce34ca16',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.090021] env[62842]: INFO networking_nsxv3.common.synchronization [req-9eed93b8-fa94-4d3a-a8c7-a5193307d7d0 req-7027cbd1-5905-42a7-8db5-aee001f6cc9f tempest-ServerRescueTestJSONUnderV235-470641360 tempest-ServerRescueTestJSONUnderV235-470641360-project-member] Enqueued Resource ID: 4e2d19a0-11e1-464b-a466-4822ce34ca16 with Priority: HIGHEST for action security_group_members [ 779.090985] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e2d19a0-11e1-464b-a466-4822ce34ca16 with Priority: HIGHEST for action security_group_members [ 779.091681] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e2d19a0-11e1-464b-a466-4822ce34ca16 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.091681] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.317637] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aa9ebb23-5905-49f2-8ee7-0bbf702efc94 [ 779.318254] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.318254] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.318254] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.318781] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.318781] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.318781] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aa9ebb23-5905-49f2-8ee7-0bbf702efc94 already deleted. [ 779.319381] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa9ebb23-5905-49f2-8ee7-0bbf702efc94" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.351634] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.352028] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.352028] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.352257] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.352375] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.352435] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e2d19a0-11e1-464b-a466-4822ce34ca16 is going to be updated. [ 779.384166] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.384413] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.384413] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.384567] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.384704] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.397214] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e2d19a0-11e1-464b-a466-4822ce34ca16 in Status: IN_PROGRESS for 2s [ 779.615538] env[62842]: INFO networking_nsxv3.common.synchronization [req-71180912-b3aa-42c3-9347-abcb70b64617 req-30cf669e-0ce6-46e6-9bea-fb0183a432aa tempest-ServersNegativeTestMultiTenantJSON-932162800 tempest-ServersNegativeTestMultiTenantJSON-932162800-project-member] Enqueued Resource ID: a14df1d2-b3a6-4075-b15b-967892c37b7e with Priority: HIGHEST for action security_group_members [ 779.616178] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a14df1d2-b3a6-4075-b15b-967892c37b7e with Priority: HIGHEST for action security_group_members [ 779.616514] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-a14df1d2-b3a6-4075-b15b-967892c37b7e taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.616644] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a14df1d2-b3a6-4075-b15b-967892c37b7e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.616713] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a14df1d2-b3a6-4075-b15b-967892c37b7e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.616927] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a14df1d2-b3a6-4075-b15b-967892c37b7e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.621286] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.621517] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.621517] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.621725] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.621812] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.621917] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a14df1d2-b3a6-4075-b15b-967892c37b7e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.651912] env[62842]: INFO networking_nsxv3.common.synchronization [req-71dd56b8-6863-482f-960c-17a1015108ad req-8c937aab-e7ef-4b7b-bd6e-5078b7734318 service nova] Enqueued Resource ID: c59f85b7-500a-400b-bef3-55b5e589248f with Priority: HIGHEST for action security_group_rules [ 779.651912] env[62842]: INFO networking_nsxv3.common.synchronization [req-71dd56b8-6863-482f-960c-17a1015108ad req-8c937aab-e7ef-4b7b-bd6e-5078b7734318 service nova] Enqueued Resource ID: c59f85b7-500a-400b-bef3-55b5e589248f with Priority: HIGHEST for action security_group_members [ 779.652438] env[62842]: INFO networking_nsxv3.common.synchronization [req-71dd56b8-6863-482f-960c-17a1015108ad req-8c937aab-e7ef-4b7b-bd6e-5078b7734318 service nova] Enqueued Resource ID: 43a4a7e4-0cf1-4fed-ab3d-a311a1da6b33 with Priority: HIGHEST for action port [ 779.653027] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c59f85b7-500a-400b-bef3-55b5e589248f with Priority: HIGHEST for action security_group_rules [ 779.653202] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c59f85b7-500a-400b-bef3-55b5e589248f with Priority: HIGHEST for action security_group_members [ 779.653327] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43a4a7e4-0cf1-4fed-ab3d-a311a1da6b33 with Priority: HIGHEST for action port [ 779.654127] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c59f85b7-500a-400b-bef3-55b5e589248f taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.654294] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c59f85b7-500a-400b-bef3-55b5e589248f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.654377] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c59f85b7-500a-400b-bef3-55b5e589248f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.654605] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c59f85b7-500a-400b-bef3-55b5e589248f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.654719] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c59f85b7-500a-400b-bef3-55b5e589248f',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.655767] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-c59f85b7-500a-400b-bef3-55b5e589248f taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.655904] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c59f85b7-500a-400b-bef3-55b5e589248f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.656419] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c59f85b7-500a-400b-bef3-55b5e589248f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.656750] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c59f85b7-500a-400b-bef3-55b5e589248f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.657026] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.657302] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.657389] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.658017] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.658017] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.658017] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c59f85b7-500a-400b-bef3-55b5e589248f',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.658971] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-43a4a7e4-0cf1-4fed-ab3d-a311a1da6b33 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.661953] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-43a4a7e4-0cf1-4fed-ab3d-a311a1da6b33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.661953] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-43a4a7e4-0cf1-4fed-ab3d-a311a1da6b33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.661953] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-43a4a7e4-0cf1-4fed-ab3d-a311a1da6b33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.661953] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43a4a7e4-0cf1-4fed-ab3d-a311a1da6b33',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.124282] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.124498] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.124498] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.124725] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.152603] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.152728] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.152837] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.152897] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.153097] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.153195] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.153264] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a14df1d2-b3a6-4075-b15b-967892c37b7e is going to be updated. [ 780.163548] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c59f85b7-500a-400b-bef3-55b5e589248f',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.167163] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-c59f85b7-500a-400b-bef3-55b5e589248f taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.167163] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c59f85b7-500a-400b-bef3-55b5e589248f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.167385] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 43a4a7e4-0cf1-4fed-ab3d-a311a1da6b33 with status ACTIVE [ 780.167435] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.167725] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.167725] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.167811] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.167902] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.168100] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.168201] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.168263] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.168415] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.168494] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.168679] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.168773] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.168834] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.168971] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.171912] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.172187] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 43a4a7e4-0cf1-4fed-ab3d-a311a1da6b33 is going to be updated. [ 780.188981] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.189189] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.189236] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.189542] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.189681] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.200146] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.200146] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.200146] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.200146] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.200146] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.200146] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-43a4a7e4-0cf1-4fed-ab3d-a311a1da6b33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.201605] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a14df1d2-b3a6-4075-b15b-967892c37b7e in Status: IN_PROGRESS for 2s [ 780.667856] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c59f85b7-500a-400b-bef3-55b5e589248f',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.887367] env[62842]: INFO networking_nsxv3.common.synchronization [None req-5b9ecab5-a6a0-4bc8-8924-d195a3fdf8e6 tempest-ServerActionsTestOtherA-1611322165 tempest-ServerActionsTestOtherA-1611322165-project-member] Enqueued Resource ID: 102e4bfe-92ec-41e7-859f-253e7a405698 with Priority: HIGHEST for action security_group_rules [ 780.888143] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 102e4bfe-92ec-41e7-859f-253e7a405698 with Priority: HIGHEST for action security_group_rules [ 780.888666] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-102e4bfe-92ec-41e7-859f-253e7a405698 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.888802] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-102e4bfe-92ec-41e7-859f-253e7a405698" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.888885] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-102e4bfe-92ec-41e7-859f-253e7a405698" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.889291] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-102e4bfe-92ec-41e7-859f-253e7a405698" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.889379] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('102e4bfe-92ec-41e7-859f-253e7a405698',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.994746] env[62842]: INFO networking_nsxv3.common.synchronization [None req-e3bf30ee-5c2b-4b5f-8f76-a27404f1fcca tempest-ServerActionsTestOtherA-1611322165 tempest-ServerActionsTestOtherA-1611322165-project-member] Enqueued Resource ID: 102e4bfe-92ec-41e7-859f-253e7a405698 with Priority: HIGHEST for action security_group_rules [ 780.995320] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 102e4bfe-92ec-41e7-859f-253e7a405698 with Priority: HIGHEST for action security_group_rules [ 780.995632] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-102e4bfe-92ec-41e7-859f-253e7a405698 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.995726] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-102e4bfe-92ec-41e7-859f-253e7a405698" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.170406] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.170406] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.170841] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.170841] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.170841] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.170841] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c59f85b7-500a-400b-bef3-55b5e589248f is going to be created. [ 781.197316] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.197465] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.197543] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.197761] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.197919] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.212018] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c59f85b7-500a-400b-bef3-55b5e589248f in Status: UNINITIALIZED for 2s [ 781.222509] env[62842]: INFO networking_nsxv3.common.synchronization [req-1a0367c9-1eb2-4369-adab-ba4bc83fd371 req-b01b72de-5ebb-4479-b2de-40e15ca58af0 tempest-AttachVolumeNegativeTest-1420230652 tempest-AttachVolumeNegativeTest-1420230652-project-member] Enqueued Resource ID: 1669144b-ae4c-489e-95db-13be5c3bfb22 with Priority: HIGHEST for action security_group_members [ 781.223975] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1669144b-ae4c-489e-95db-13be5c3bfb22 with Priority: HIGHEST for action security_group_members [ 781.223975] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-1669144b-ae4c-489e-95db-13be5c3bfb22 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.223975] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1669144b-ae4c-489e-95db-13be5c3bfb22" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.223975] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1669144b-ae4c-489e-95db-13be5c3bfb22" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.223975] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1669144b-ae4c-489e-95db-13be5c3bfb22" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.227806] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.228788] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.228788] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.228788] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.228788] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.228788] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1669144b-ae4c-489e-95db-13be5c3bfb22',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.410257] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e2d19a0-11e1-464b-a466-4822ce34ca16 in Status: SUCCESS [ 781.410257] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.410257] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.410257] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.410257] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.410257] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.410257] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.410257] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.410257] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.410257] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.410257] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e2d19a0-11e1-464b-a466-4822ce34ca16 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.410257] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.410257] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.410257] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.410257] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.410257] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.410257] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.411695] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.412543] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.412853] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.413309] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4e2d19a0-11e1-464b-a466-4822ce34ca16',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.415783] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.416103] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.417029] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.417029] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.417029] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.417029] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 102e4bfe-92ec-41e7-859f-253e7a405698 already deleted. [ 781.417029] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-102e4bfe-92ec-41e7-859f-253e7a405698" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.417029] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.417320] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.417418] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.417768] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.417869] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.418055] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.418164] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.418285] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e2d19a0-11e1-464b-a466-4822ce34ca16',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.419444] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-102e4bfe-92ec-41e7-859f-253e7a405698" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.420330] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-102e4bfe-92ec-41e7-859f-253e7a405698" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.420330] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('102e4bfe-92ec-41e7-859f-253e7a405698',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.570137] env[62842]: INFO networking_nsxv3.common.synchronization [None req-e517e93c-329d-41bd-b45b-0b45f0527336 None None] Enqueued Resource ID: 0d4af30c-58ac-4b81-a450-883e20653f14 with Priority: HIGHEST for action port [ 781.570137] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d4af30c-58ac-4b81-a450-883e20653f14 with Priority: HIGHEST for action port [ 781.570486] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-0d4af30c-58ac-4b81-a450-883e20653f14 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.570486] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0d4af30c-58ac-4b81-a450-883e20653f14" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.570486] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0d4af30c-58ac-4b81-a450-883e20653f14" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.570728] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0d4af30c-58ac-4b81-a450-883e20653f14" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.572185] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d4af30c-58ac-4b81-a450-883e20653f14',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.731605] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.732478] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.732478] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.732478] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.752487] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.752781] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.752910] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.752974] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.753190] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.753274] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.753362] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1669144b-ae4c-489e-95db-13be5c3bfb22 is going to be updated. [ 781.800387] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.800679] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.800679] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.800893] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.800935] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.810622] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1669144b-ae4c-489e-95db-13be5c3bfb22 in Status: IN_PROGRESS for 2s [ 781.925534] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4e2d19a0-11e1-464b-a466-4822ce34ca16: rpc.has_security_group_logging(os_id): False [ 781.926936] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.927129] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.927165] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.927345] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.945995] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.946140] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.946886] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.946993] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.948734] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.949278] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.949429] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.949570] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.949786] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.949907] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.950037] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e2d19a0-11e1-464b-a466-4822ce34ca16 is going to be updated. [ 781.951301] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.951725] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.951870] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.951979] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 102e4bfe-92ec-41e7-859f-253e7a405698 already deleted. [ 781.952100] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-102e4bfe-92ec-41e7-859f-253e7a405698" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.952265] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.952424] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.952503] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.952697] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.952802] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.952836] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.952967] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.953052] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.953237] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.953334] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.953434] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.953508] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.953579] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.953787] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.953853] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.953938] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.954131] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.954191] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.954225] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e2d19a0-11e1-464b-a466-4822ce34ca16 is going to be updated. [ 781.991480] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.991643] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.991717] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.991933] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.992097] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.001611] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e2d19a0-11e1-464b-a466-4822ce34ca16 in Status: IN_PROGRESS for 2s [ 782.038474] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.038717] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.038797] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.039027] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.039178] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.054674] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e2d19a0-11e1-464b-a466-4822ce34ca16 in Status: IN_PROGRESS for 2s [ 782.074298] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0d4af30c-58ac-4b81-a450-883e20653f14 [ 782.075160] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.075633] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.075734] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.075962] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.076087] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.076206] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0d4af30c-58ac-4b81-a450-883e20653f14 already deleted. [ 782.076293] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0d4af30c-58ac-4b81-a450-883e20653f14" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.215231] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a14df1d2-b3a6-4075-b15b-967892c37b7e in Status: SUCCESS [ 782.215231] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a14df1d2-b3a6-4075-b15b-967892c37b7e deletion is rescheduled due to dependency. [ 782.215231] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a14df1d2-b3a6-4075-b15b-967892c37b7e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.223318] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c59f85b7-500a-400b-bef3-55b5e589248f in Status: SUCCESS [ 783.223776] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c59f85b7-500a-400b-bef3-55b5e589248f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.223837] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c59f85b7-500a-400b-bef3-55b5e589248f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.224093] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c59f85b7-500a-400b-bef3-55b5e589248f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.224323] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.224440] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.224507] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.224726] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.224818] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.224915] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c59f85b7-500a-400b-bef3-55b5e589248f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.225014] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c59f85b7-500a-400b-bef3-55b5e589248f',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.727811] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c59f85b7-500a-400b-bef3-55b5e589248f',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.821880] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1669144b-ae4c-489e-95db-13be5c3bfb22 in Status: SUCCESS [ 783.821880] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1669144b-ae4c-489e-95db-13be5c3bfb22 deletion is rescheduled due to dependency. [ 783.821880] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1669144b-ae4c-489e-95db-13be5c3bfb22" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.017129] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e2d19a0-11e1-464b-a466-4822ce34ca16 in Status: SUCCESS [ 784.017129] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e2d19a0-11e1-464b-a466-4822ce34ca16 deletion is rescheduled due to dependency. [ 784.017301] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.069809] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e2d19a0-11e1-464b-a466-4822ce34ca16 in Status: SUCCESS [ 784.070057] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.070248] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.070469] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.070991] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e2d19a0-11e1-464b-a466-4822ce34ca16',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.231632] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c59f85b7-500a-400b-bef3-55b5e589248f: rpc.has_security_group_logging(os_id): False [ 784.250076] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.250076] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.250427] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.250427] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.250611] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.251110] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.251110] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.251110] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.251602] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.251602] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.251602] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c59f85b7-500a-400b-bef3-55b5e589248f is going to be created. [ 784.311721] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.311868] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.311939] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.312247] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.312370] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.326020] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c59f85b7-500a-400b-bef3-55b5e589248f in Status: IN_PROGRESS for 2s [ 784.594853] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.595031] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.595120] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.595876] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.595876] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.595876] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e2d19a0-11e1-464b-a466-4822ce34ca16 is going to be deleted. [ 784.662756] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.663886] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.663886] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.663886] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.663886] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.663886] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e2d19a0-11e1-464b-a466-4822ce34ca16" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.342278] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c59f85b7-500a-400b-bef3-55b5e589248f in Status: SUCCESS [ 786.342610] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c59f85b7-500a-400b-bef3-55b5e589248f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.571403] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 786.571494] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 787.864317] env[62842]: INFO networking_nsxv3.common.synchronization [None req-01ef4e2c-d0e6-4eb1-b222-17b2f892a09f None None] Enqueued Resource ID: 6f9410a2-185e-4e67-a89f-319275447137 with Priority: HIGHEST for action port [ 787.868032] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f9410a2-185e-4e67-a89f-319275447137 with Priority: HIGHEST for action port [ 787.868032] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-6f9410a2-185e-4e67-a89f-319275447137 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.868032] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6f9410a2-185e-4e67-a89f-319275447137" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.868032] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6f9410a2-185e-4e67-a89f-319275447137" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.869099] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6f9410a2-185e-4e67-a89f-319275447137" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.869316] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6f9410a2-185e-4e67-a89f-319275447137',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.149514] env[62842]: INFO networking_nsxv3.common.synchronization [req-88fb2790-74ea-41cc-9910-d0683dc44698 req-87215a04-c679-4745-931b-37ebc292b11d tempest-ServerRescueTestJSON-960362394 tempest-ServerRescueTestJSON-960362394-project-member] Enqueued Resource ID: e1bf27f4-91cf-44a6-8115-e3876163a888 with Priority: HIGHEST for action security_group_members [ 788.153020] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1bf27f4-91cf-44a6-8115-e3876163a888 with Priority: HIGHEST for action security_group_members [ 788.153020] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1bf27f4-91cf-44a6-8115-e3876163a888 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.153020] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.153020] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.153020] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.153020] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.153020] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.153020] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.153020] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.153020] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.153020] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e1bf27f4-91cf-44a6-8115-e3876163a888',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.380717] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6f9410a2-185e-4e67-a89f-319275447137 [ 788.380717] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.380717] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.380717] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.380717] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.380717] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.380717] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6f9410a2-185e-4e67-a89f-319275447137 already deleted. [ 788.380717] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6f9410a2-185e-4e67-a89f-319275447137" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.655414] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e1bf27f4-91cf-44a6-8115-e3876163a888',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.829831] env[62842]: INFO networking_nsxv3.common.synchronization [req-5d3fa2d5-0a57-4dba-9d20-74906e986b13 req-36e86b37-3c30-436c-be38-e549ad698e8e tempest-AttachInterfacesTestJSON-2140085841 tempest-AttachInterfacesTestJSON-2140085841-project-member] Enqueued Resource ID: e509406e-18a0-4842-8350-5830bdc3ec79 with Priority: HIGHEST for action security_group_members [ 788.829831] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e509406e-18a0-4842-8350-5830bdc3ec79 with Priority: HIGHEST for action security_group_members [ 788.829831] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e509406e-18a0-4842-8350-5830bdc3ec79 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.829831] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e509406e-18a0-4842-8350-5830bdc3ec79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.829831] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e509406e-18a0-4842-8350-5830bdc3ec79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.829831] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e509406e-18a0-4842-8350-5830bdc3ec79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.835049] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.835049] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.835049] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.835049] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.835049] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.835049] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e509406e-18a0-4842-8350-5830bdc3ec79',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.158695] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e1bf27f4-91cf-44a6-8115-e3876163a888',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.338692] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.338867] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.338936] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.339170] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.339257] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.339511] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.339683] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.339683] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.339874] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.339874] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.339958] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e509406e-18a0-4842-8350-5830bdc3ec79 already deleted. [ 789.340052] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e509406e-18a0-4842-8350-5830bdc3ec79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.369843] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-416 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.370247] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-416" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.370518] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-416" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.370918] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-416" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.371291] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.371537] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.371742] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.372137] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.372406] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.373027] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 789.373027] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 789.373027] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 789.373213] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 789.373343] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 789.373551] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 789.373774] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 789.401513] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 789.401748] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 789.401957] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 789.402211] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-416" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.402638] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-a649072e-232c-4df1-ac24-0c7606973315 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.402899] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-a649072e-232c-4df1-ac24-0c7606973315" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.403144] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-a649072e-232c-4df1-ac24-0c7606973315" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.403463] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-a649072e-232c-4df1-ac24-0c7606973315" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.403666] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a649072e-232c-4df1-ac24-0c7606973315',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.659536] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.659713] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.659773] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.660387] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.660387] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.660387] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1bf27f4-91cf-44a6-8115-e3876163a888 is going to be updated. [ 789.686966] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.687171] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.687215] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.687400] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.687569] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.697421] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1bf27f4-91cf-44a6-8115-e3876163a888 in Status: IN_PROGRESS for 2s [ 789.909684] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.909841] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.909882] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.910184] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.910348] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.910603] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port a649072e-232c-4df1-ac24-0c7606973315 not found, creating... [ 789.910801] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.910967] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.911103] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.911332] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.911475] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.911794] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.911961] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.912591] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.912835] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.913012] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.913447] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: a649072e-232c-4df1-ac24-0c7606973315 is going to be created. [ 789.936600] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.936838] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.937040] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.937273] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.937606] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.937744] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-a649072e-232c-4df1-ac24-0c7606973315" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.647179] env[62842]: INFO networking_nsxv3.common.synchronization [None req-3984d0b1-064d-4ff9-a876-58d46f79870c None None] Enqueued Resource ID: 6632efd9-afb1-4462-b265-bad5942a0a18 with Priority: HIGHEST for action port [ 790.648559] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6632efd9-afb1-4462-b265-bad5942a0a18 with Priority: HIGHEST for action port [ 790.649080] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-6632efd9-afb1-4462-b265-bad5942a0a18 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.650842] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6632efd9-afb1-4462-b265-bad5942a0a18" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.650842] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6632efd9-afb1-4462-b265-bad5942a0a18" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.650842] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6632efd9-afb1-4462-b265-bad5942a0a18" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.650842] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6632efd9-afb1-4462-b265-bad5942a0a18',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.787273] env[62842]: INFO networking_nsxv3.common.synchronization [req-5d3fa2d5-0a57-4dba-9d20-74906e986b13 req-9fa665bd-d11b-4276-a74e-216971036982 service nova] Enqueued Resource ID: e509406e-18a0-4842-8350-5830bdc3ec79 with Priority: HIGHEST for action security_group_rules [ 790.787273] env[62842]: INFO networking_nsxv3.common.synchronization [req-5d3fa2d5-0a57-4dba-9d20-74906e986b13 req-9fa665bd-d11b-4276-a74e-216971036982 service nova] Enqueued Resource ID: e509406e-18a0-4842-8350-5830bdc3ec79 with Priority: HIGHEST for action security_group_members [ 790.787273] env[62842]: INFO networking_nsxv3.common.synchronization [req-5d3fa2d5-0a57-4dba-9d20-74906e986b13 req-9fa665bd-d11b-4276-a74e-216971036982 service nova] Enqueued Resource ID: a649072e-232c-4df1-ac24-0c7606973315 with Priority: HIGHEST for action port [ 790.787273] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e509406e-18a0-4842-8350-5830bdc3ec79 with Priority: HIGHEST for action security_group_rules [ 790.787273] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e509406e-18a0-4842-8350-5830bdc3ec79 with Priority: HIGHEST for action security_group_members [ 790.787273] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a649072e-232c-4df1-ac24-0c7606973315 with Priority: HIGHEST for action port [ 790.787273] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e509406e-18a0-4842-8350-5830bdc3ec79 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.787273] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e509406e-18a0-4842-8350-5830bdc3ec79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.787273] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e509406e-18a0-4842-8350-5830bdc3ec79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.787273] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e509406e-18a0-4842-8350-5830bdc3ec79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.788647] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e509406e-18a0-4842-8350-5830bdc3ec79',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.790103] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e509406e-18a0-4842-8350-5830bdc3ec79 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.790488] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e509406e-18a0-4842-8350-5830bdc3ec79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.790722] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e509406e-18a0-4842-8350-5830bdc3ec79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.791235] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e509406e-18a0-4842-8350-5830bdc3ec79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.791550] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.793093] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.793093] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.793093] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.793093] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.793093] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e509406e-18a0-4842-8350-5830bdc3ec79',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.796728] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-a649072e-232c-4df1-ac24-0c7606973315 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.796728] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a649072e-232c-4df1-ac24-0c7606973315" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.796728] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a649072e-232c-4df1-ac24-0c7606973315" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.796728] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a649072e-232c-4df1-ac24-0c7606973315" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.796728] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a649072e-232c-4df1-ac24-0c7606973315',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.134029] env[62842]: INFO networking_nsxv3.common.synchronization [req-afb6cbfa-bc86-4508-bf8c-7b4f54079b40 req-2a6575a4-609a-4ee5-9a2e-1bea59c03896 tempest-ServerActionsTestJSON-670456711 tempest-ServerActionsTestJSON-670456711-project-member] Enqueued Resource ID: 03708cfa-ea22-40d4-8c09-177242e076fa with Priority: HIGHEST for action security_group_members [ 791.134951] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03708cfa-ea22-40d4-8c09-177242e076fa with Priority: HIGHEST for action security_group_members [ 791.137031] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-03708cfa-ea22-40d4-8c09-177242e076fa taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.137031] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03708cfa-ea22-40d4-8c09-177242e076fa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.137031] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03708cfa-ea22-40d4-8c09-177242e076fa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.137031] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03708cfa-ea22-40d4-8c09-177242e076fa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.137031] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.137031] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.137031] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.137031] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.137031] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.137031] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('03708cfa-ea22-40d4-8c09-177242e076fa',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.153200] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6632efd9-afb1-4462-b265-bad5942a0a18 [ 791.153480] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.153617] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.153687] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.153894] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.154017] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.154091] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6632efd9-afb1-4462-b265-bad5942a0a18 already deleted. [ 791.154272] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6632efd9-afb1-4462-b265-bad5942a0a18" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.297174] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e509406e-18a0-4842-8350-5830bdc3ec79',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.298447] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e509406e-18a0-4842-8350-5830bdc3ec79 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.298447] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e509406e-18a0-4842-8350-5830bdc3ec79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.298655] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a649072e-232c-4df1-ac24-0c7606973315 with status ACTIVE [ 791.298698] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.298775] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.299041] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.299133] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.299177] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.300552] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.300552] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.300552] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.300552] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.300552] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.300552] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.300552] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.302026] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.302026] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.302026] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.302026] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a649072e-232c-4df1-ac24-0c7606973315 is going to be updated. [ 791.324945] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.325101] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.325182] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.325376] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.325511] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.325667] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a649072e-232c-4df1-ac24-0c7606973315" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.535656] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-830 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.535861] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-830" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.535987] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-830" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.536358] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-830" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.537081] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.537268] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.537392] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.537684] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.537838] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.538059] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 791.538177] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 791.538287] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 791.538396] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 791.538504] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 791.538609] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 791.538740] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 791.558236] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 791.558436] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 791.559663] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 791.559663] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-830" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.559663] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-bf285bb6-bdef-4ca1-a4ee-e8ffd99a2825 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.559663] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-bf285bb6-bdef-4ca1-a4ee-e8ffd99a2825" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.559663] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-bf285bb6-bdef-4ca1-a4ee-e8ffd99a2825" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.560159] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-bf285bb6-bdef-4ca1-a4ee-e8ffd99a2825" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.560159] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf285bb6-bdef-4ca1-a4ee-e8ffd99a2825',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.639181] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.639311] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.639311] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.639563] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.639563] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.639843] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.639944] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.640015] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.640171] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.640250] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.640337] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03708cfa-ea22-40d4-8c09-177242e076fa already deleted. [ 791.640416] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03708cfa-ea22-40d4-8c09-177242e076fa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.707435] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1bf27f4-91cf-44a6-8115-e3876163a888 in Status: IN_PROGRESS for 4s [ 791.804356] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e509406e-18a0-4842-8350-5830bdc3ec79',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.067806] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.068044] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.068367] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.068451] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.068616] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.068794] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port bf285bb6-bdef-4ca1-a4ee-e8ffd99a2825 not found, creating... [ 792.069626] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.069626] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.069626] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.069626] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.069874] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.070828] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.070828] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.070828] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.070828] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.073506] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.073707] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: bf285bb6-bdef-4ca1-a4ee-e8ffd99a2825 is going to be created. [ 792.096876] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.096876] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.096876] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.096876] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.097140] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.097184] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-bf285bb6-bdef-4ca1-a4ee-e8ffd99a2825" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.308426] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.308652] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.308652] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.308857] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.308950] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.309073] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e509406e-18a0-4842-8350-5830bdc3ec79 is going to be created. [ 792.335762] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.336013] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.336013] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.336299] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.336335] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.346532] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e509406e-18a0-4842-8350-5830bdc3ec79 in Status: UNINITIALIZED for 2s [ 792.860880] env[62842]: INFO networking_nsxv3.common.synchronization [req-afb6cbfa-bc86-4508-bf8c-7b4f54079b40 req-07f0bdb2-257c-4246-aca0-3cfe90ad5ebc service nova] Enqueued Resource ID: 03708cfa-ea22-40d4-8c09-177242e076fa with Priority: HIGHEST for action security_group_rules [ 792.861249] env[62842]: INFO networking_nsxv3.common.synchronization [req-afb6cbfa-bc86-4508-bf8c-7b4f54079b40 req-07f0bdb2-257c-4246-aca0-3cfe90ad5ebc service nova] Enqueued Resource ID: 03708cfa-ea22-40d4-8c09-177242e076fa with Priority: HIGHEST for action security_group_members [ 792.861249] env[62842]: INFO networking_nsxv3.common.synchronization [req-afb6cbfa-bc86-4508-bf8c-7b4f54079b40 req-07f0bdb2-257c-4246-aca0-3cfe90ad5ebc service nova] Enqueued Resource ID: bf285bb6-bdef-4ca1-a4ee-e8ffd99a2825 with Priority: HIGHEST for action port [ 792.861455] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03708cfa-ea22-40d4-8c09-177242e076fa with Priority: HIGHEST for action security_group_rules [ 792.861578] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03708cfa-ea22-40d4-8c09-177242e076fa with Priority: HIGHEST for action security_group_members [ 792.861673] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf285bb6-bdef-4ca1-a4ee-e8ffd99a2825 with Priority: HIGHEST for action port [ 792.862553] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-03708cfa-ea22-40d4-8c09-177242e076fa taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.862732] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-03708cfa-ea22-40d4-8c09-177242e076fa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.862841] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-03708cfa-ea22-40d4-8c09-177242e076fa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.863091] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-03708cfa-ea22-40d4-8c09-177242e076fa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.865456] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('03708cfa-ea22-40d4-8c09-177242e076fa',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.865456] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-03708cfa-ea22-40d4-8c09-177242e076fa taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.865456] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03708cfa-ea22-40d4-8c09-177242e076fa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.865456] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03708cfa-ea22-40d4-8c09-177242e076fa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.865456] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03708cfa-ea22-40d4-8c09-177242e076fa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.865456] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.865456] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.865456] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.865456] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.865456] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.865456] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('03708cfa-ea22-40d4-8c09-177242e076fa',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.866129] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf285bb6-bdef-4ca1-a4ee-e8ffd99a2825 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.866277] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf285bb6-bdef-4ca1-a4ee-e8ffd99a2825" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.866382] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf285bb6-bdef-4ca1-a4ee-e8ffd99a2825" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.866559] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf285bb6-bdef-4ca1-a4ee-e8ffd99a2825" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.866675] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf285bb6-bdef-4ca1-a4ee-e8ffd99a2825',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.372189] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bf285bb6-bdef-4ca1-a4ee-e8ffd99a2825 with status ACTIVE [ 793.372494] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.372741] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.372852] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.373105] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.373226] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.373452] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.373559] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.373613] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.373765] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.374023] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.374023] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.374169] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.374169] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.374296] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.374365] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.374445] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bf285bb6-bdef-4ca1-a4ee-e8ffd99a2825 is going to be updated. [ 793.375871] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('03708cfa-ea22-40d4-8c09-177242e076fa',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.376791] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-03708cfa-ea22-40d4-8c09-177242e076fa taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.376898] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03708cfa-ea22-40d4-8c09-177242e076fa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.401078] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.401296] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.401344] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.401565] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.401722] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.401884] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf285bb6-bdef-4ca1-a4ee-e8ffd99a2825" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.719856] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1bf27f4-91cf-44a6-8115-e3876163a888 in Status: SUCCESS [ 793.720122] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.878396] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('03708cfa-ea22-40d4-8c09-177242e076fa',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.357435] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e509406e-18a0-4842-8350-5830bdc3ec79 in Status: SUCCESS [ 794.357696] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e509406e-18a0-4842-8350-5830bdc3ec79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.357870] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e509406e-18a0-4842-8350-5830bdc3ec79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.358310] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e509406e-18a0-4842-8350-5830bdc3ec79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.358447] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.358542] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.358599] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.359098] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.359098] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.359098] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e509406e-18a0-4842-8350-5830bdc3ec79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.359098] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e509406e-18a0-4842-8350-5830bdc3ec79',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.380750] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.380896] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.380959] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.381183] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.381275] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.381376] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03708cfa-ea22-40d4-8c09-177242e076fa is going to be created. [ 794.408411] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.408505] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.408583] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.408804] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.408962] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.419193] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03708cfa-ea22-40d4-8c09-177242e076fa in Status: UNINITIALIZED for 2s [ 794.861861] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e509406e-18a0-4842-8350-5830bdc3ec79',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.364513] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e509406e-18a0-4842-8350-5830bdc3ec79: rpc.has_security_group_logging(os_id): False [ 795.386078] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.386078] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.386078] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.386408] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.386548] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.387241] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.387241] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.387241] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.387241] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.387241] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.387590] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e509406e-18a0-4842-8350-5830bdc3ec79 is going to be created. [ 795.450441] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.452281] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.452281] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.452420] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.452590] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.465232] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e509406e-18a0-4842-8350-5830bdc3ec79 in Status: IN_PROGRESS for 2s [ 796.432799] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03708cfa-ea22-40d4-8c09-177242e076fa in Status: SUCCESS [ 796.433170] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03708cfa-ea22-40d4-8c09-177242e076fa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.433233] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03708cfa-ea22-40d4-8c09-177242e076fa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.434788] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03708cfa-ea22-40d4-8c09-177242e076fa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.434788] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.434788] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.434788] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.434788] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.434788] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.434788] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03708cfa-ea22-40d4-8c09-177242e076fa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.434788] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('03708cfa-ea22-40d4-8c09-177242e076fa',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.938042] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('03708cfa-ea22-40d4-8c09-177242e076fa',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.440578] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 03708cfa-ea22-40d4-8c09-177242e076fa: rpc.has_security_group_logging(os_id): False [ 797.464168] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.464168] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.464168] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.464473] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.464587] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.464977] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.465106] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.465189] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.465847] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.465847] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.465847] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 03708cfa-ea22-40d4-8c09-177242e076fa is going to be created. [ 797.482225] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e509406e-18a0-4842-8350-5830bdc3ec79 in Status: SUCCESS [ 797.482585] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e509406e-18a0-4842-8350-5830bdc3ec79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.536477] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.536643] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.536711] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.537396] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.537396] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.553789] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 03708cfa-ea22-40d4-8c09-177242e076fa in Status: IN_PROGRESS for 2s [ 797.863508] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 797.863703] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 799.137420] env[62842]: INFO networking_nsxv3.common.synchronization [req-9c77e6d7-b341-48d8-aad5-0935be0d832e req-a68583e7-7d5d-4205-b9e4-913007b6c5d2 tempest-ServersTestFqdnHostnames-908808954 tempest-ServersTestFqdnHostnames-908808954-project-member] Enqueued Resource ID: cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37 with Priority: HIGHEST for action security_group_members [ 799.138015] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37 with Priority: HIGHEST for action security_group_members [ 799.138367] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.138516] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.138591] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.138791] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.138948] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.139076] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.139144] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.139278] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.139383] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.139483] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.572268] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 03708cfa-ea22-40d4-8c09-177242e076fa in Status: SUCCESS [ 799.573047] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-03708cfa-ea22-40d4-8c09-177242e076fa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.641732] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.641970] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.641970] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.642245] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.671386] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.671712] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.671877] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.672035] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.672256] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.672379] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.672487] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37 is going to be updated. [ 799.706171] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.706385] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.706455] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.706666] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.706833] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.714076] env[62842]: INFO networking_nsxv3.common.synchronization [req-3df4a994-54b8-4880-a75f-61b41ad0491e req-f979f91e-0d18-41aa-9ae0-a40be8cfdaac tempest-ImagesOneServerNegativeTestJSON-864549307 tempest-ImagesOneServerNegativeTestJSON-864549307-project-member] Enqueued Resource ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd with Priority: HIGHEST for action security_group_members [ 799.714805] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd with Priority: HIGHEST for action security_group_members [ 799.716856] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.716856] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.716856] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.716856] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.716856] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.716856] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.716856] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.716856] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.716856] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.716856] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('82e532f4-b8b0-4a4a-affc-1ab5a63253cd',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.720027] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37 in Status: IN_PROGRESS for 2s [ 800.175365] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-821 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.176635] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-821" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.176635] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-821" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.176635] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-821" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.176635] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.176635] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.176635] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.177042] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.177042] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.177158] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 800.177212] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 800.177428] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 800.177428] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 800.177613] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 800.178195] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 800.178195] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 800.197791] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 800.198016] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 800.198174] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 800.198357] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-821" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.198689] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-bcbd9f15-9933-4dce-9f5a-d7f2dd6aa8c2 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.198905] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-bcbd9f15-9933-4dce-9f5a-d7f2dd6aa8c2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.199073] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-bcbd9f15-9933-4dce-9f5a-d7f2dd6aa8c2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.199386] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-bcbd9f15-9933-4dce-9f5a-d7f2dd6aa8c2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.199529] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcbd9f15-9933-4dce-9f5a-d7f2dd6aa8c2',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.219455] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.219599] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.219657] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.219955] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.220107] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.220319] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.220428] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.220473] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.220628] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.220744] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.220890] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd is going to be deleted. [ 800.255216] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.255216] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.255408] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.255545] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.255646] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.255935] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.702211] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.702368] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.702464] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.702741] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.703115] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.703203] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port bcbd9f15-9933-4dce-9f5a-d7f2dd6aa8c2 not found, creating... [ 800.703415] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.703575] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.703695] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.703920] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.704075] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.704372] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.704526] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.704642] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.704916] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.704979] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.705140] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: bcbd9f15-9933-4dce-9f5a-d7f2dd6aa8c2 is going to be created. [ 800.727607] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.727995] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.728178] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.728464] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.728708] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.728939] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-bcbd9f15-9933-4dce-9f5a-d7f2dd6aa8c2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.731179] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37 in Status: SUCCESS [ 801.731516] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37 deletion is rescheduled due to dependency. [ 801.731516] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.919708] env[62842]: INFO networking_nsxv3.common.synchronization [req-3df4a994-54b8-4880-a75f-61b41ad0491e req-4da051db-0f15-43ad-bc82-8725c6f54790 service nova] Enqueued Resource ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd with Priority: HIGHEST for action security_group_rules [ 801.919708] env[62842]: INFO networking_nsxv3.common.synchronization [req-3df4a994-54b8-4880-a75f-61b41ad0491e req-4da051db-0f15-43ad-bc82-8725c6f54790 service nova] Enqueued Resource ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd with Priority: HIGHEST for action security_group_members [ 801.919708] env[62842]: INFO networking_nsxv3.common.synchronization [req-3df4a994-54b8-4880-a75f-61b41ad0491e req-4da051db-0f15-43ad-bc82-8725c6f54790 service nova] Enqueued Resource ID: bcbd9f15-9933-4dce-9f5a-d7f2dd6aa8c2 with Priority: HIGHEST for action port [ 801.919708] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd with Priority: HIGHEST for action security_group_rules [ 801.919708] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd with Priority: HIGHEST for action security_group_members [ 801.919708] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcbd9f15-9933-4dce-9f5a-d7f2dd6aa8c2 with Priority: HIGHEST for action port [ 801.920123] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-82e532f4-b8b0-4a4a-affc-1ab5a63253cd taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.920123] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.920123] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.920357] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.920357] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('82e532f4-b8b0-4a4a-affc-1ab5a63253cd',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.923502] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.923502] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.923502] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.923502] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.923502] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.923975] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.923975] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.923975] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.923975] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.923975] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('82e532f4-b8b0-4a4a-affc-1ab5a63253cd',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.924832] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-bcbd9f15-9933-4dce-9f5a-d7f2dd6aa8c2 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.924832] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bcbd9f15-9933-4dce-9f5a-d7f2dd6aa8c2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.925024] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bcbd9f15-9933-4dce-9f5a-d7f2dd6aa8c2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.925024] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bcbd9f15-9933-4dce-9f5a-d7f2dd6aa8c2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.925140] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcbd9f15-9933-4dce-9f5a-d7f2dd6aa8c2',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.428648] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.428648] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.428648] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('82e532f4-b8b0-4a4a-affc-1ab5a63253cd',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.430458] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bcbd9f15-9933-4dce-9f5a-d7f2dd6aa8c2 with status ACTIVE [ 802.433470] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.433470] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.433470] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.433470] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.433470] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.433470] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.433470] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.433470] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.433470] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.433470] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.433470] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.433470] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.433470] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.433470] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.433470] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.433470] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bcbd9f15-9933-4dce-9f5a-d7f2dd6aa8c2 is going to be updated. [ 802.436330] env[62842]: INFO networking_nsxv3.common.synchronization [req-19c323a7-17ed-42c1-ab04-125f299aacf4 req-d705666a-fcc2-4cd9-9458-890b8b804d07 tempest-AttachInterfacesUnderV243Test-764117880 tempest-AttachInterfacesUnderV243Test-764117880-project-member] Enqueued Resource ID: 83478649-c10f-45af-9cd9-d412883cd575 with Priority: HIGHEST for action security_group_members [ 802.436330] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83478649-c10f-45af-9cd9-d412883cd575 with Priority: HIGHEST for action security_group_members [ 802.436330] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-83478649-c10f-45af-9cd9-d412883cd575 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.436330] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83478649-c10f-45af-9cd9-d412883cd575" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.436330] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83478649-c10f-45af-9cd9-d412883cd575" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.436608] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83478649-c10f-45af-9cd9-d412883cd575" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.437098] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.437098] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.437098] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.437301] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.437348] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.437433] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83478649-c10f-45af-9cd9-d412883cd575',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.456356] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.456558] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.456632] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.456912] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.457107] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.457321] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bcbd9f15-9933-4dce-9f5a-d7f2dd6aa8c2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.804301] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-196 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.804621] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-196" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.804705] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-196" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.805230] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-196" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.805517] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.805686] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.805808] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.806062] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.806216] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.806430] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 802.806543] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 802.806654] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 802.806766] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 802.806907] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 802.807044] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 802.807189] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 802.827015] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 802.827457] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 802.827613] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 802.827847] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-196" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.828264] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-da77ac4f-85e3-4f62-8133-70d8204acf94 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.828788] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-da77ac4f-85e3-4f62-8133-70d8204acf94" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.828913] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-da77ac4f-85e3-4f62-8133-70d8204acf94" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.829263] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-da77ac4f-85e3-4f62-8133-70d8204acf94" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.829405] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da77ac4f-85e3-4f62-8133-70d8204acf94',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.931051] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('82e532f4-b8b0-4a4a-affc-1ab5a63253cd',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.940743] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.940743] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.940743] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.940743] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.940948] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.941075] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.941137] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.941195] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.941762] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.941762] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.941762] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83478649-c10f-45af-9cd9-d412883cd575 already deleted. [ 802.941762] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83478649-c10f-45af-9cd9-d412883cd575" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.333958] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.333958] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.333958] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.333958] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.333958] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.333958] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port da77ac4f-85e3-4f62-8133-70d8204acf94 not found, creating... [ 803.333958] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.333958] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.333958] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.333958] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.334854] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.335374] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.338075] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.338075] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.338075] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.338075] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.338075] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: da77ac4f-85e3-4f62-8133-70d8204acf94 is going to be created. [ 803.360406] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.360406] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.360406] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.360622] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.361512] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.361512] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-da77ac4f-85e3-4f62-8133-70d8204acf94" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.435935] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.436096] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.436177] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.436434] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.436532] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.436637] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd is going to be created. [ 803.463274] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.463452] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.463452] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.463643] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.463843] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.486822] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd in Status: UNINITIALIZED for 2s [ 804.124482] env[62842]: INFO networking_nsxv3.common.synchronization [req-19c323a7-17ed-42c1-ab04-125f299aacf4 req-724235e0-174e-4503-93b5-c0b9c7dd37f7 service nova] Enqueued Resource ID: 83478649-c10f-45af-9cd9-d412883cd575 with Priority: HIGHEST for action security_group_rules [ 804.124828] env[62842]: INFO networking_nsxv3.common.synchronization [req-19c323a7-17ed-42c1-ab04-125f299aacf4 req-724235e0-174e-4503-93b5-c0b9c7dd37f7 service nova] Enqueued Resource ID: 83478649-c10f-45af-9cd9-d412883cd575 with Priority: HIGHEST for action security_group_members [ 804.124828] env[62842]: INFO networking_nsxv3.common.synchronization [req-19c323a7-17ed-42c1-ab04-125f299aacf4 req-724235e0-174e-4503-93b5-c0b9c7dd37f7 service nova] Enqueued Resource ID: da77ac4f-85e3-4f62-8133-70d8204acf94 with Priority: HIGHEST for action port [ 804.125108] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83478649-c10f-45af-9cd9-d412883cd575 with Priority: HIGHEST for action security_group_rules [ 804.125242] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83478649-c10f-45af-9cd9-d412883cd575 with Priority: HIGHEST for action security_group_members [ 804.125341] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da77ac4f-85e3-4f62-8133-70d8204acf94 with Priority: HIGHEST for action port [ 804.126830] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-83478649-c10f-45af-9cd9-d412883cd575 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.127060] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-83478649-c10f-45af-9cd9-d412883cd575" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.127232] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-83478649-c10f-45af-9cd9-d412883cd575" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.127590] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-83478649-c10f-45af-9cd9-d412883cd575" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.127792] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('83478649-c10f-45af-9cd9-d412883cd575',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.129044] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-83478649-c10f-45af-9cd9-d412883cd575 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.129336] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83478649-c10f-45af-9cd9-d412883cd575" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.129336] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83478649-c10f-45af-9cd9-d412883cd575" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.130550] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83478649-c10f-45af-9cd9-d412883cd575" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.130550] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.130550] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.130550] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.130550] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.131188] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.134843] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83478649-c10f-45af-9cd9-d412883cd575',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.135431] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-da77ac4f-85e3-4f62-8133-70d8204acf94 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.135431] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-da77ac4f-85e3-4f62-8133-70d8204acf94" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.135431] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-da77ac4f-85e3-4f62-8133-70d8204acf94" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.135759] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-da77ac4f-85e3-4f62-8133-70d8204acf94" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.135759] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da77ac4f-85e3-4f62-8133-70d8204acf94',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.638248] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-83478649-c10f-45af-9cd9-d412883cd575 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.638248] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83478649-c10f-45af-9cd9-d412883cd575" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.642585] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port da77ac4f-85e3-4f62-8133-70d8204acf94 with status ACTIVE [ 804.642585] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.642816] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.642816] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.644215] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.644215] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.644215] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.644215] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.644215] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.645359] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.645359] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.645359] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.645359] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.645359] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.645359] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.645359] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.645359] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: da77ac4f-85e3-4f62-8133-70d8204acf94 is going to be updated. [ 804.646349] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('83478649-c10f-45af-9cd9-d412883cd575',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.671174] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.671359] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.671443] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.671583] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.671745] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.671859] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-da77ac4f-85e3-4f62-8133-70d8204acf94" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.721850] env[62842]: INFO networking_nsxv3.common.synchronization [req-5cad0839-1a9a-48f4-93c5-c959fe43f368 req-215eeecc-5b0b-4bbc-b8ab-0eecb510411f tempest-ServersAdminTestJSON-1475908229 tempest-ServersAdminTestJSON-1475908229-project-member] Enqueued Resource ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e with Priority: HIGHEST for action security_group_members [ 804.722541] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e with Priority: HIGHEST for action security_group_members [ 804.722864] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.722992] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.723073] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.723285] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.723434] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.723525] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.723898] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.723898] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.723898] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.723898] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7acb0f4-6157-4a0c-977e-ee6a2808aa0e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.148975] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('83478649-c10f-45af-9cd9-d412883cd575',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.225892] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e7acb0f4-6157-4a0c-977e-ee6a2808aa0e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.498080] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd in Status: SUCCESS [ 805.498313] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.498501] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.498734] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.498954] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.499109] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.499152] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.499311] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.499398] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.499494] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.499644] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('82e532f4-b8b0-4a4a-affc-1ab5a63253cd',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.651709] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.651923] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.652086] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.652358] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.652494] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.652649] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83478649-c10f-45af-9cd9-d412883cd575 is going to be created. [ 805.682731] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.682731] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.682731] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.682731] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.682731] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.694330] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83478649-c10f-45af-9cd9-d412883cd575 in Status: UNINITIALIZED for 2s [ 805.728715] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e7acb0f4-6157-4a0c-977e-ee6a2808aa0e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.004083] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.004211] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.004363] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.004588] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.004800] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.004947] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.005074] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.005177] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.005269] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.005336] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.005527] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.005655] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.005655] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.005814] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.005891] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.006656] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.006656] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.006656] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.006656] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.006656] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.006656] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('82e532f4-b8b0-4a4a-affc-1ab5a63253cd',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.234689] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.234689] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.234689] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.234689] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.234689] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.234689] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e is going to be updated. [ 806.264117] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.264117] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.264117] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.264365] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.264414] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.276094] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e in Status: IN_PROGRESS for 2s [ 806.509371] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 82e532f4-b8b0-4a4a-affc-1ab5a63253cd: rpc.has_security_group_logging(os_id): False [ 806.529436] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.529436] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.529436] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.529719] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.529719] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.529989] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.530114] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.530158] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.530337] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.530397] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.530568] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.530646] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.530779] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.530957] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.531107] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.531220] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.531314] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.531392] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.531546] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.531619] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.531734] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd is going to be created. [ 806.593334] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.593523] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.593523] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.593748] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.593927] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.606650] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd in Status: IN_PROGRESS for 2s [ 807.705986] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83478649-c10f-45af-9cd9-d412883cd575 in Status: UNINITIALIZED for 4s [ 808.289281] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e in Status: SUCCESS [ 808.289281] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.627818] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd in Status: SUCCESS [ 808.627983] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.724368] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83478649-c10f-45af-9cd9-d412883cd575 in Status: SUCCESS [ 809.724368] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83478649-c10f-45af-9cd9-d412883cd575" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.724727] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 809.724727] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 809.724815] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83478649-c10f-45af-9cd9-d412883cd575" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.725125] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83478649-c10f-45af-9cd9-d412883cd575" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.725233] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.725349] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.725408] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.725547] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.725623] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.725703] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83478649-c10f-45af-9cd9-d412883cd575" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.725786] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('83478649-c10f-45af-9cd9-d412883cd575',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.228700] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('83478649-c10f-45af-9cd9-d412883cd575',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.734605] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 83478649-c10f-45af-9cd9-d412883cd575: rpc.has_security_group_logging(os_id): False [ 810.763286] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.763505] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.763505] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.763702] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.763835] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.764644] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.764644] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.764644] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.764644] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.764644] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.764644] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 83478649-c10f-45af-9cd9-d412883cd575 is going to be created. [ 810.836839] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.837150] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.837150] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.837286] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.837467] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.848024] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 83478649-c10f-45af-9cd9-d412883cd575 in Status: IN_PROGRESS for 2s [ 812.633985] env[62842]: INFO networking_nsxv3.common.synchronization [req-4a5f2a38-9c32-49be-b849-c7f5f77e3dfb req-103944f2-c4ec-4a51-8aec-20810bde199a tempest-ServerTagsTestJSON-1637647200 tempest-ServerTagsTestJSON-1637647200-project-member] Enqueued Resource ID: 017b2ee9-30e5-4870-86c3-53c03de20d66 with Priority: HIGHEST for action security_group_members [ 812.633985] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 017b2ee9-30e5-4870-86c3-53c03de20d66 with Priority: HIGHEST for action security_group_members [ 812.634340] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-017b2ee9-30e5-4870-86c3-53c03de20d66 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.634412] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-017b2ee9-30e5-4870-86c3-53c03de20d66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.634465] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-017b2ee9-30e5-4870-86c3-53c03de20d66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.634713] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-017b2ee9-30e5-4870-86c3-53c03de20d66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.634872] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.634967] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.635154] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.635313] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.635394] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.635485] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('017b2ee9-30e5-4870-86c3-53c03de20d66',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.864323] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 83478649-c10f-45af-9cd9-d412883cd575 in Status: SUCCESS [ 812.864323] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-83478649-c10f-45af-9cd9-d412883cd575" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.137786] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-994 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.138698] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-994" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.139142] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-994" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.139252] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-994" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.140019] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.141168] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.141168] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.141168] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.141168] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.141168] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 813.141168] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 813.141404] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 813.141404] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 813.141475] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 813.141565] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 813.141700] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 813.143178] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.143268] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.143339] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.143500] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.143582] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.143759] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.143853] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.143915] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.144066] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.144142] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.144224] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 017b2ee9-30e5-4870-86c3-53c03de20d66 already deleted. [ 813.144303] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-017b2ee9-30e5-4870-86c3-53c03de20d66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.163707] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 813.163996] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 813.164334] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 813.164534] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-994" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.164866] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-e84e8607-3d1b-4a35-b13b-fb878cab1a5f taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.165080] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-e84e8607-3d1b-4a35-b13b-fb878cab1a5f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.165182] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-e84e8607-3d1b-4a35-b13b-fb878cab1a5f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.165501] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-e84e8607-3d1b-4a35-b13b-fb878cab1a5f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.165645] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e84e8607-3d1b-4a35-b13b-fb878cab1a5f',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.669437] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.669905] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.669983] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.670389] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.670614] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.670850] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port e84e8607-3d1b-4a35-b13b-fb878cab1a5f not found, creating... [ 813.671401] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.671637] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.671814] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.672114] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.672267] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.672602] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.672768] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.672893] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.673167] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.674408] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.674408] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: e84e8607-3d1b-4a35-b13b-fb878cab1a5f is going to be created. [ 813.698399] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.698632] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.698729] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.699042] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.699283] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.699514] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-e84e8607-3d1b-4a35-b13b-fb878cab1a5f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.197036] env[62842]: INFO networking_nsxv3.common.synchronization [req-4a5f2a38-9c32-49be-b849-c7f5f77e3dfb req-fc2174ed-dd4c-4c90-900f-a9d7cdce3cc7 service nova] Enqueued Resource ID: 017b2ee9-30e5-4870-86c3-53c03de20d66 with Priority: HIGHEST for action security_group_rules [ 815.197036] env[62842]: INFO networking_nsxv3.common.synchronization [req-4a5f2a38-9c32-49be-b849-c7f5f77e3dfb req-fc2174ed-dd4c-4c90-900f-a9d7cdce3cc7 service nova] Enqueued Resource ID: 017b2ee9-30e5-4870-86c3-53c03de20d66 with Priority: HIGHEST for action security_group_members [ 815.197036] env[62842]: INFO networking_nsxv3.common.synchronization [req-4a5f2a38-9c32-49be-b849-c7f5f77e3dfb req-fc2174ed-dd4c-4c90-900f-a9d7cdce3cc7 service nova] Enqueued Resource ID: e84e8607-3d1b-4a35-b13b-fb878cab1a5f with Priority: HIGHEST for action port [ 815.197036] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 017b2ee9-30e5-4870-86c3-53c03de20d66 with Priority: HIGHEST for action security_group_rules [ 815.197036] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 017b2ee9-30e5-4870-86c3-53c03de20d66 with Priority: HIGHEST for action security_group_members [ 815.197036] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e84e8607-3d1b-4a35-b13b-fb878cab1a5f with Priority: HIGHEST for action port [ 815.197036] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-017b2ee9-30e5-4870-86c3-53c03de20d66 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.197036] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-017b2ee9-30e5-4870-86c3-53c03de20d66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.197036] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-017b2ee9-30e5-4870-86c3-53c03de20d66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.197618] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-017b2ee9-30e5-4870-86c3-53c03de20d66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.197618] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('017b2ee9-30e5-4870-86c3-53c03de20d66',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.199881] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-017b2ee9-30e5-4870-86c3-53c03de20d66 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.199881] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-017b2ee9-30e5-4870-86c3-53c03de20d66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.199881] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-017b2ee9-30e5-4870-86c3-53c03de20d66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.199881] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-017b2ee9-30e5-4870-86c3-53c03de20d66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.199881] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.199881] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.199881] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.199881] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.199881] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.199881] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('017b2ee9-30e5-4870-86c3-53c03de20d66',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.200842] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-e84e8607-3d1b-4a35-b13b-fb878cab1a5f taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.201016] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e84e8607-3d1b-4a35-b13b-fb878cab1a5f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.202065] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e84e8607-3d1b-4a35-b13b-fb878cab1a5f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.202357] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e84e8607-3d1b-4a35-b13b-fb878cab1a5f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.202436] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e84e8607-3d1b-4a35-b13b-fb878cab1a5f',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.559213] env[62842]: INFO networking_nsxv3.common.synchronization [req-616307bd-f413-4fa3-a780-331082f2968e req-7a229183-3bee-4f5c-96ea-2566fc823ca7 tempest-ServersWithSpecificFlavorTestJSON-2019624802 tempest-ServersWithSpecificFlavorTestJSON-2019624802-project-member] Enqueued Resource ID: 16baecd6-bda3-40e1-98ef-4e238a3fc354 with Priority: HIGHEST for action security_group_members [ 815.560499] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16baecd6-bda3-40e1-98ef-4e238a3fc354 with Priority: HIGHEST for action security_group_members [ 815.560499] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-16baecd6-bda3-40e1-98ef-4e238a3fc354 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.560499] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16baecd6-bda3-40e1-98ef-4e238a3fc354" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.560499] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16baecd6-bda3-40e1-98ef-4e238a3fc354" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.561699] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16baecd6-bda3-40e1-98ef-4e238a3fc354" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.561894] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.562019] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.562086] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.562309] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.562398] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.562503] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16baecd6-bda3-40e1-98ef-4e238a3fc354',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.707664] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('017b2ee9-30e5-4870-86c3-53c03de20d66',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.707664] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-017b2ee9-30e5-4870-86c3-53c03de20d66 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.707664] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-017b2ee9-30e5-4870-86c3-53c03de20d66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.707664] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e84e8607-3d1b-4a35-b13b-fb878cab1a5f with status ACTIVE [ 815.707664] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.707664] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.707664] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.707664] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.707664] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.707664] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.707664] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.707664] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.707664] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.707664] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.709234] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.709537] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.709701] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.709992] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.710241] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.710425] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e84e8607-3d1b-4a35-b13b-fb878cab1a5f is going to be updated. [ 815.746500] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.746500] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.746500] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.746500] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.746500] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.746500] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e84e8607-3d1b-4a35-b13b-fb878cab1a5f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.065175] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.065343] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.065414] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.065635] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.085767] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.086045] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.086180] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.086250] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.086458] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.086558] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.086628] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16baecd6-bda3-40e1-98ef-4e238a3fc354 is going to be updated. [ 816.115433] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.115566] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.115653] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.115931] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.115980] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.126133] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16baecd6-bda3-40e1-98ef-4e238a3fc354 in Status: IN_PROGRESS for 2s [ 816.212638] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('017b2ee9-30e5-4870-86c3-53c03de20d66',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.715099] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.722241] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.722241] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.722241] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.722241] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.722241] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 017b2ee9-30e5-4870-86c3-53c03de20d66 is going to be created. [ 816.754997] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.754997] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.754997] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.755270] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.755463] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.782596] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 017b2ee9-30e5-4870-86c3-53c03de20d66 in Status: UNINITIALIZED for 2s [ 816.872211] env[62842]: INFO networking_nsxv3.common.synchronization [req-c31b6c2c-1736-4e50-85fa-cb9c3d2ea21c req-f8dc8915-5031-40aa-b7fa-99f7c01e686e tempest-AttachVolumeShelveTestJSON-759972748 tempest-AttachVolumeShelveTestJSON-759972748-project-member] Enqueued Resource ID: e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55 with Priority: HIGHEST for action security_group_members [ 816.872768] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55 with Priority: HIGHEST for action security_group_members [ 816.875549] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.875549] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.875549] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.875549] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.878202] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.878369] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.878472] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.878734] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.878826] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.878943] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.139749] env[62842]: INFO networking_nsxv3.common.synchronization [req-575d0cfd-fdd2-461d-89a8-cf9279b30c9c req-c9030667-15ee-4d2f-b078-64033b03ffcd tempest-MigrationsAdminTest-2116750055 tempest-MigrationsAdminTest-2116750055-project-member] Enqueued Resource ID: 38b4d382-6400-4588-b620-faecfba1fd64 with Priority: HIGHEST for action security_group_members [ 817.142107] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38b4d382-6400-4588-b620-faecfba1fd64 with Priority: HIGHEST for action security_group_members [ 817.142107] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-38b4d382-6400-4588-b620-faecfba1fd64 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.142107] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.142107] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.142107] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.142107] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.142107] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.142107] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.142107] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.142107] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.142107] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38b4d382-6400-4588-b620-faecfba1fd64',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.382225] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.382225] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.382225] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.382683] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.408177] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.408459] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.408580] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.408638] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.408848] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.408950] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.409067] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55 is going to be updated. [ 817.439330] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.439330] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.439419] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.439568] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.439704] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.450885] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55 in Status: IN_PROGRESS for 2s [ 817.645450] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('38b4d382-6400-4588-b620-faecfba1fd64',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.138342] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16baecd6-bda3-40e1-98ef-4e238a3fc354 in Status: SUCCESS [ 818.138723] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16baecd6-bda3-40e1-98ef-4e238a3fc354 deletion is rescheduled due to dependency. [ 818.138959] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16baecd6-bda3-40e1-98ef-4e238a3fc354" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.148693] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('38b4d382-6400-4588-b620-faecfba1fd64',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.652432] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.652773] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.652773] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.653066] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.653267] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.653348] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38b4d382-6400-4588-b620-faecfba1fd64 is going to be updated. [ 818.688892] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.689107] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.689183] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.689469] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.689580] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.704422] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38b4d382-6400-4588-b620-faecfba1fd64 in Status: IN_PROGRESS for 2s [ 818.728029] env[62842]: INFO networking_nsxv3.common.synchronization [req-5f85baa0-20c4-4af9-91f9-18e4bbd638b8 req-db0c6d98-68bb-4670-ab20-ab764204a50a tempest-ServerActionsTestOtherA-1611322165 tempest-ServerActionsTestOtherA-1611322165-project-member] Enqueued Resource ID: 102e4bfe-92ec-41e7-859f-253e7a405698 with Priority: HIGHEST for action security_group_members [ 818.728633] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 102e4bfe-92ec-41e7-859f-253e7a405698 with Priority: HIGHEST for action security_group_members [ 818.728931] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-102e4bfe-92ec-41e7-859f-253e7a405698 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.729142] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-102e4bfe-92ec-41e7-859f-253e7a405698" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.729215] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-102e4bfe-92ec-41e7-859f-253e7a405698" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.729480] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-102e4bfe-92ec-41e7-859f-253e7a405698" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.731040] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.731040] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.731040] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.731215] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.731215] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.731354] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('102e4bfe-92ec-41e7-859f-253e7a405698',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.796191] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 017b2ee9-30e5-4870-86c3-53c03de20d66 in Status: SUCCESS [ 818.796548] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-017b2ee9-30e5-4870-86c3-53c03de20d66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.796673] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-017b2ee9-30e5-4870-86c3-53c03de20d66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.796955] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-017b2ee9-30e5-4870-86c3-53c03de20d66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.797230] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.797357] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.797415] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.797622] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.797687] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.797773] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-017b2ee9-30e5-4870-86c3-53c03de20d66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.798108] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('017b2ee9-30e5-4870-86c3-53c03de20d66',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.122931] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-8 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.126020] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.126020] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.126020] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.126020] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.126020] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.126020] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.126308] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.126469] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.126686] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 819.126800] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 819.126909] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 819.127027] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 819.127140] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 819.127244] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 819.127378] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 819.152042] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 819.152042] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 819.152042] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 819.152042] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.152042] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-7d24ca69-2b36-4610-8b45-9e40b4b46c83 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.152042] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-7d24ca69-2b36-4610-8b45-9e40b4b46c83" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.152433] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-7d24ca69-2b36-4610-8b45-9e40b4b46c83" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.152515] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-7d24ca69-2b36-4610-8b45-9e40b4b46c83" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.152668] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d24ca69-2b36-4610-8b45-9e40b4b46c83',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.233974] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.234212] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.234321] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.234617] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.234722] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.235091] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.235224] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.235324] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.235493] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.235573] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.235663] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 102e4bfe-92ec-41e7-859f-253e7a405698 already deleted. [ 819.235790] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-102e4bfe-92ec-41e7-859f-253e7a405698" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.300921] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-017b2ee9-30e5-4870-86c3-53c03de20d66 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.301110] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-017b2ee9-30e5-4870-86c3-53c03de20d66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.301171] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-017b2ee9-30e5-4870-86c3-53c03de20d66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.301491] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-017b2ee9-30e5-4870-86c3-53c03de20d66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.301868] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.301868] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.301964] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.302093] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.302187] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.302278] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-017b2ee9-30e5-4870-86c3-53c03de20d66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.302478] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-017b2ee9-30e5-4870-86c3-53c03de20d66 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.302610] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-017b2ee9-30e5-4870-86c3-53c03de20d66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.302649] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-017b2ee9-30e5-4870-86c3-53c03de20d66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.302775] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-017b2ee9-30e5-4870-86c3-53c03de20d66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.302915] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.303018] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.303082] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.303220] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.303297] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.303378] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-017b2ee9-30e5-4870-86c3-53c03de20d66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.303468] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('017b2ee9-30e5-4870-86c3-53c03de20d66',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.462053] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55 in Status: SUCCESS [ 819.462240] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55 deletion is rescheduled due to dependency. [ 819.462326] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.655067] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.655432] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.655466] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.655741] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.655894] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.656066] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 7d24ca69-2b36-4610-8b45-9e40b4b46c83 not found, creating... [ 819.656415] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.656497] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.656628] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.656853] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.657489] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.657489] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.657489] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.657718] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.657904] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.658270] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.658493] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 7d24ca69-2b36-4610-8b45-9e40b4b46c83 is going to be created. [ 819.686758] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.687062] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.687288] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.687675] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.688021] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.688307] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-7d24ca69-2b36-4610-8b45-9e40b4b46c83" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.807500] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 017b2ee9-30e5-4870-86c3-53c03de20d66: rpc.has_security_group_logging(os_id): False [ 819.838058] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.838301] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.838399] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.838847] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.838847] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.839126] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.839193] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.839278] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.839482] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.839576] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.840242] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.840242] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.840376] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.840609] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.840775] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.841248] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.841460] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.841521] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.841704] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.842203] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.842203] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 017b2ee9-30e5-4870-86c3-53c03de20d66 is going to be created. [ 819.934091] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.934317] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.934317] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.934683] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.934934] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.952373] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 017b2ee9-30e5-4870-86c3-53c03de20d66 in Status: IN_PROGRESS for 2s [ 820.432122] env[62842]: INFO networking_nsxv3.common.synchronization [req-5f85baa0-20c4-4af9-91f9-18e4bbd638b8 req-9d109fdf-20eb-4c0c-a2ed-73402b6ad9f8 service nova] Enqueued Resource ID: 102e4bfe-92ec-41e7-859f-253e7a405698 with Priority: HIGHEST for action security_group_rules [ 820.432486] env[62842]: INFO networking_nsxv3.common.synchronization [req-5f85baa0-20c4-4af9-91f9-18e4bbd638b8 req-9d109fdf-20eb-4c0c-a2ed-73402b6ad9f8 service nova] Enqueued Resource ID: 102e4bfe-92ec-41e7-859f-253e7a405698 with Priority: HIGHEST for action security_group_members [ 820.432665] env[62842]: INFO networking_nsxv3.common.synchronization [req-5f85baa0-20c4-4af9-91f9-18e4bbd638b8 req-9d109fdf-20eb-4c0c-a2ed-73402b6ad9f8 service nova] Enqueued Resource ID: 7d24ca69-2b36-4610-8b45-9e40b4b46c83 with Priority: HIGHEST for action port [ 820.432916] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 102e4bfe-92ec-41e7-859f-253e7a405698 with Priority: HIGHEST for action security_group_rules [ 820.433057] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 102e4bfe-92ec-41e7-859f-253e7a405698 with Priority: HIGHEST for action security_group_members [ 820.433152] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d24ca69-2b36-4610-8b45-9e40b4b46c83 with Priority: HIGHEST for action port [ 820.433782] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-102e4bfe-92ec-41e7-859f-253e7a405698 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.433863] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-102e4bfe-92ec-41e7-859f-253e7a405698" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.433949] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-102e4bfe-92ec-41e7-859f-253e7a405698" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.434108] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-102e4bfe-92ec-41e7-859f-253e7a405698" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.434174] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('102e4bfe-92ec-41e7-859f-253e7a405698',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.435469] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-102e4bfe-92ec-41e7-859f-253e7a405698 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.435577] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-102e4bfe-92ec-41e7-859f-253e7a405698" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.435637] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-102e4bfe-92ec-41e7-859f-253e7a405698" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.435803] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-102e4bfe-92ec-41e7-859f-253e7a405698" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.435946] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.436055] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.436114] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.436639] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.436639] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.436639] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('102e4bfe-92ec-41e7-859f-253e7a405698',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.437133] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-7d24ca69-2b36-4610-8b45-9e40b4b46c83 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.438062] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7d24ca69-2b36-4610-8b45-9e40b4b46c83" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.438062] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7d24ca69-2b36-4610-8b45-9e40b4b46c83" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.438062] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7d24ca69-2b36-4610-8b45-9e40b4b46c83" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.438062] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d24ca69-2b36-4610-8b45-9e40b4b46c83',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.717220] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38b4d382-6400-4588-b620-faecfba1fd64 in Status: IN_PROGRESS for 4s [ 820.942890] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('102e4bfe-92ec-41e7-859f-253e7a405698',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.946974] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-102e4bfe-92ec-41e7-859f-253e7a405698 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.947151] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-102e4bfe-92ec-41e7-859f-253e7a405698" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.947338] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7d24ca69-2b36-4610-8b45-9e40b4b46c83 with status ACTIVE [ 820.947518] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.947626] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.947693] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.947927] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.948628] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.948628] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.948628] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.948628] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.948628] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.948628] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.948825] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.948825] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.948888] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.949418] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.949418] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.949418] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7d24ca69-2b36-4610-8b45-9e40b4b46c83 is going to be updated. [ 820.970141] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.970263] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.970649] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.970649] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.970649] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.970799] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7d24ca69-2b36-4610-8b45-9e40b4b46c83" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.452126] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('102e4bfe-92ec-41e7-859f-253e7a405698',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.957625] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.957946] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.957946] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.958054] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.958129] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.958233] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 102e4bfe-92ec-41e7-859f-253e7a405698 is going to be created. [ 821.973138] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 017b2ee9-30e5-4870-86c3-53c03de20d66 in Status: SUCCESS [ 821.973401] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-017b2ee9-30e5-4870-86c3-53c03de20d66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.989583] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.989583] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.989583] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.989583] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.989583] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.005661] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 102e4bfe-92ec-41e7-859f-253e7a405698 in Status: UNINITIALIZED for 2s [ 822.153487] env[62842]: INFO networking_nsxv3.common.synchronization [req-4d61387f-2708-4b96-9150-45fd8b9c068e req-48d71389-ba36-460b-bb03-28111aa15639 tempest-AttachVolumeNegativeTest-1420230652 tempest-AttachVolumeNegativeTest-1420230652-project-member] Enqueued Resource ID: c0ccbbde-9e94-45de-b00c-8f135b84465d with Priority: HIGHEST for action security_group_members [ 822.154102] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0ccbbde-9e94-45de-b00c-8f135b84465d with Priority: HIGHEST for action security_group_members [ 822.154430] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0ccbbde-9e94-45de-b00c-8f135b84465d taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.154577] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0ccbbde-9e94-45de-b00c-8f135b84465d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.154607] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0ccbbde-9e94-45de-b00c-8f135b84465d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.154809] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0ccbbde-9e94-45de-b00c-8f135b84465d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.154993] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.155441] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.155522] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.155709] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.155888] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.155888] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0ccbbde-9e94-45de-b00c-8f135b84465d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.659336] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.659507] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.659580] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.659804] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.682350] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.682610] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.682730] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.682794] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.683042] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.683131] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.683224] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0ccbbde-9e94-45de-b00c-8f135b84465d is going to be updated. [ 822.709298] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.709586] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.709586] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.709804] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.710020] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.719730] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0ccbbde-9e94-45de-b00c-8f135b84465d in Status: IN_PROGRESS for 2s [ 822.727467] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38b4d382-6400-4588-b620-faecfba1fd64 in Status: SUCCESS [ 822.727690] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.466811] env[62842]: INFO networking_nsxv3.common.synchronization [req-67b32242-eec2-45b1-8f76-4045f7fd0844 req-ac389f9f-b98f-4e7c-884f-06fa0cbb5df9 tempest-ImagesOneServerNegativeTestJSON-864549307 tempest-ImagesOneServerNegativeTestJSON-864549307-project-member] Enqueued Resource ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd with Priority: HIGHEST for action security_group_members [ 823.468207] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd with Priority: HIGHEST for action security_group_members [ 823.468207] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.468207] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.468207] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.468207] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.468446] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.468446] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.468522] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.468653] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.468734] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.468824] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('82e532f4-b8b0-4a4a-affc-1ab5a63253cd',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.972204] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.972518] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.972665] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.973015] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.973185] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.973421] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.973529] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.973591] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.973763] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.973847] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.973939] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd is going to be updated. [ 824.018392] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 102e4bfe-92ec-41e7-859f-253e7a405698 in Status: SUCCESS [ 824.018618] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-102e4bfe-92ec-41e7-859f-253e7a405698" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.018771] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-102e4bfe-92ec-41e7-859f-253e7a405698" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.019665] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-102e4bfe-92ec-41e7-859f-253e7a405698" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.020401] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.020401] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.020401] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.020586] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.020620] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.020904] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-102e4bfe-92ec-41e7-859f-253e7a405698" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.020904] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('102e4bfe-92ec-41e7-859f-253e7a405698',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.022808] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.022949] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.023057] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.023303] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.023504] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.036083] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd in Status: IN_PROGRESS for 2s [ 824.526723] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('102e4bfe-92ec-41e7-859f-253e7a405698',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.731733] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0ccbbde-9e94-45de-b00c-8f135b84465d in Status: SUCCESS [ 824.731920] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0ccbbde-9e94-45de-b00c-8f135b84465d deletion is rescheduled due to dependency. [ 824.732048] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0ccbbde-9e94-45de-b00c-8f135b84465d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.031596] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 102e4bfe-92ec-41e7-859f-253e7a405698: rpc.has_security_group_logging(os_id): False [ 825.049629] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.049824] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.050053] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.050275] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.050453] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.050685] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.050890] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.050992] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.051177] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.051256] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.051350] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 102e4bfe-92ec-41e7-859f-253e7a405698 is going to be created. [ 825.110042] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.110241] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.110318] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.110581] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.110649] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.122664] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 102e4bfe-92ec-41e7-859f-253e7a405698 in Status: IN_PROGRESS for 2s [ 826.047440] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd in Status: SUCCESS [ 826.047713] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd deletion is rescheduled due to dependency. [ 826.047756] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.919677] env[62842]: INFO networking_nsxv3.common.synchronization [req-c3c41fe8-c554-4bc6-97b3-119a2baeb3db req-14d03dec-8150-447d-ba8a-ea26958651ab tempest-VolumesAssistedSnapshotsTest-756271320 tempest-VolumesAssistedSnapshotsTest-756271320-project-member] Enqueued Resource ID: 92cba5b3-76df-405c-acab-0f3155ce22e5 with Priority: HIGHEST for action security_group_members [ 826.920437] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92cba5b3-76df-405c-acab-0f3155ce22e5 with Priority: HIGHEST for action security_group_members [ 826.920681] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-92cba5b3-76df-405c-acab-0f3155ce22e5 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.920802] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92cba5b3-76df-405c-acab-0f3155ce22e5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.920873] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92cba5b3-76df-405c-acab-0f3155ce22e5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.921332] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92cba5b3-76df-405c-acab-0f3155ce22e5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.921555] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.921691] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.921756] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.921933] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.922080] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.922172] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92cba5b3-76df-405c-acab-0f3155ce22e5',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.135229] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 102e4bfe-92ec-41e7-859f-253e7a405698 in Status: SUCCESS [ 827.135535] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-102e4bfe-92ec-41e7-859f-253e7a405698" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.424708] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.424905] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.425064] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.425280] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.447708] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.448012] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.448133] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.448196] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.448397] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.448472] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.448560] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92cba5b3-76df-405c-acab-0f3155ce22e5 is going to be updated. [ 827.481017] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.481017] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.481017] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.481222] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.481365] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.492324] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92cba5b3-76df-405c-acab-0f3155ce22e5 in Status: IN_PROGRESS for 2s [ 827.855756] env[62842]: INFO networking_nsxv3.common.synchronization [req-1d0fc5ce-5710-472a-a12d-1b79a7774c2b req-2e993804-e904-4e57-91d8-0d965b080ee2 tempest-DeleteServersTestJSON-1113791748 tempest-DeleteServersTestJSON-1113791748-project-member] Enqueued Resource ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 with Priority: HIGHEST for action security_group_members [ 827.856535] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 with Priority: HIGHEST for action security_group_members [ 827.856653] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-35146777-fd28-4ac7-b454-f7dd3fbb5846 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.856903] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.856903] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.857655] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.857909] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.858046] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.858109] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.858764] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.859181] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.859515] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('35146777-fd28-4ac7-b454-f7dd3fbb5846',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.362161] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.362544] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.362544] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.362544] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.362635] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.366023] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.366023] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.366023] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.366023] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.366023] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.366023] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 is going to be deleted. [ 828.402023] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.402023] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.402023] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.402023] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.402023] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.402023] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.467777] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-681 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.468107] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-681" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.468266] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-681" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.468574] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-681" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.470039] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.470039] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.470039] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.470039] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.470039] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.470039] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 828.470039] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 828.470331] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 828.470331] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 828.470452] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 828.470648] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 828.471768] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 828.519710] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 828.520063] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.049 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 828.520230] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 828.520409] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-681" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.520792] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-4a0e4c83-a482-46ee-b955-5de3269fc827 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.521064] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-4a0e4c83-a482-46ee-b955-5de3269fc827" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.521191] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-4a0e4c83-a482-46ee-b955-5de3269fc827" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.521535] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-4a0e4c83-a482-46ee-b955-5de3269fc827" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.523901] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a0e4c83-a482-46ee-b955-5de3269fc827',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.744519] env[62842]: INFO networking_nsxv3.common.synchronization [req-2bc03ea3-662b-47a6-9a6c-92040273c560 req-5475aca1-d0cb-4b4a-b0b0-05fc185bed71 tempest-ServersTestManualDisk-131723153 tempest-ServersTestManualDisk-131723153-project-member] Enqueued Resource ID: eb447582-c572-481b-befa-98a3dcf064c3 with Priority: HIGHEST for action security_group_members [ 828.745291] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb447582-c572-481b-befa-98a3dcf064c3 with Priority: HIGHEST for action security_group_members [ 828.745779] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb447582-c572-481b-befa-98a3dcf064c3 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.745900] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb447582-c572-481b-befa-98a3dcf064c3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.745900] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb447582-c572-481b-befa-98a3dcf064c3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.746645] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb447582-c572-481b-befa-98a3dcf064c3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.746820] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.746929] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.746991] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.747178] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.747264] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.747361] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb447582-c572-481b-befa-98a3dcf064c3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.025763] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.025763] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.025763] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.025763] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.025763] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.025763] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 4a0e4c83-a482-46ee-b955-5de3269fc827 not found, creating... [ 829.026073] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.026446] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.026735] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.027041] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.027573] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.027573] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.027712] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.027865] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.028160] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.028950] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.029156] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 4a0e4c83-a482-46ee-b955-5de3269fc827 is going to be created. [ 829.034804] env[62842]: INFO networking_nsxv3.common.synchronization [req-b0dde915-1a55-4d5d-ac18-b88ef3eb4937 req-fcdbd010-53e0-4e29-a114-6b1ee7e682bb tempest-ServerTagsTestJSON-1637647200 tempest-ServerTagsTestJSON-1637647200-project-member] Enqueued Resource ID: 017b2ee9-30e5-4870-86c3-53c03de20d66 with Priority: HIGHEST for action security_group_members [ 829.035760] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 017b2ee9-30e5-4870-86c3-53c03de20d66 with Priority: HIGHEST for action security_group_members [ 829.036082] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-017b2ee9-30e5-4870-86c3-53c03de20d66 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.036202] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-017b2ee9-30e5-4870-86c3-53c03de20d66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.036302] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-017b2ee9-30e5-4870-86c3-53c03de20d66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.036457] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-017b2ee9-30e5-4870-86c3-53c03de20d66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.036601] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.036695] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.036757] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.036897] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.036980] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.037085] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('017b2ee9-30e5-4870-86c3-53c03de20d66',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.057607] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.057768] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.058577] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.058577] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.058577] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.058746] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-4a0e4c83-a482-46ee-b955-5de3269fc827" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.249116] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.249285] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.249360] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.251112] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.287050] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.287274] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.287403] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.287482] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.287679] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.287824] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.287906] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb447582-c572-481b-befa-98a3dcf064c3 is going to be updated. [ 829.326187] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.326397] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.326990] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.326990] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.327191] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.345043] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb447582-c572-481b-befa-98a3dcf064c3 in Status: IN_PROGRESS for 2s [ 829.507019] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92cba5b3-76df-405c-acab-0f3155ce22e5 in Status: SUCCESS [ 829.507019] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92cba5b3-76df-405c-acab-0f3155ce22e5 deletion is rescheduled due to dependency. [ 829.507019] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92cba5b3-76df-405c-acab-0f3155ce22e5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.540393] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.540393] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.540393] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.540594] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.540650] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.540844] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.541032] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.541032] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.541207] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.541255] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.541553] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 017b2ee9-30e5-4870-86c3-53c03de20d66 is going to be updated. [ 829.595844] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.596056] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.596056] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.596268] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.596548] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.615144] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 017b2ee9-30e5-4870-86c3-53c03de20d66 in Status: IN_PROGRESS for 2s [ 829.825674] env[62842]: INFO networking_nsxv3.common.synchronization [req-1d0fc5ce-5710-472a-a12d-1b79a7774c2b req-2c36b184-67d9-4679-85bb-5720a02d325e service nova] Enqueued Resource ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 with Priority: HIGHEST for action security_group_rules [ 829.825957] env[62842]: INFO networking_nsxv3.common.synchronization [req-1d0fc5ce-5710-472a-a12d-1b79a7774c2b req-2c36b184-67d9-4679-85bb-5720a02d325e service nova] Enqueued Resource ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 with Priority: HIGHEST for action security_group_members [ 829.827247] env[62842]: INFO networking_nsxv3.common.synchronization [req-1d0fc5ce-5710-472a-a12d-1b79a7774c2b req-2c36b184-67d9-4679-85bb-5720a02d325e service nova] Enqueued Resource ID: 4a0e4c83-a482-46ee-b955-5de3269fc827 with Priority: HIGHEST for action port [ 829.828974] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 with Priority: HIGHEST for action security_group_rules [ 829.828974] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 with Priority: HIGHEST for action security_group_members [ 829.828974] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a0e4c83-a482-46ee-b955-5de3269fc827 with Priority: HIGHEST for action port [ 829.828974] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-35146777-fd28-4ac7-b454-f7dd3fbb5846 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.828974] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.828974] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.828974] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.829305] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('35146777-fd28-4ac7-b454-f7dd3fbb5846',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.830285] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-35146777-fd28-4ac7-b454-f7dd3fbb5846 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.830645] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.830745] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.831015] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.831255] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.831431] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.831493] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.831722] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.831844] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.831973] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('35146777-fd28-4ac7-b454-f7dd3fbb5846',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.833083] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a0e4c83-a482-46ee-b955-5de3269fc827 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.833176] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a0e4c83-a482-46ee-b955-5de3269fc827" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.833276] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a0e4c83-a482-46ee-b955-5de3269fc827" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.833471] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a0e4c83-a482-46ee-b955-5de3269fc827" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.833577] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a0e4c83-a482-46ee-b955-5de3269fc827',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.338023] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-35146777-fd28-4ac7-b454-f7dd3fbb5846 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.338023] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.338023] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('35146777-fd28-4ac7-b454-f7dd3fbb5846',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.338023] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4a0e4c83-a482-46ee-b955-5de3269fc827 with status ACTIVE [ 830.338023] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.338023] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.338023] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.338023] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.338023] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.339594] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.340221] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.340528] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.344282] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.344282] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.344282] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.344282] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.344282] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.344282] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.344282] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.344282] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4a0e4c83-a482-46ee-b955-5de3269fc827 is going to be updated. [ 830.371126] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.371331] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.371331] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.371531] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.371726] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.371874] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a0e4c83-a482-46ee-b955-5de3269fc827" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.614638] env[62842]: INFO networking_nsxv3.common.synchronization [req-a7d1935d-41bd-4670-84be-18508f7f5999 req-67a044d4-e59b-4f89-bb17-80cca6cb5509 tempest-ServerRescueTestJSON-960362394 tempest-ServerRescueTestJSON-960362394-project-member] Enqueued Resource ID: e1bf27f4-91cf-44a6-8115-e3876163a888 with Priority: HIGHEST for action security_group_members [ 830.616112] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1bf27f4-91cf-44a6-8115-e3876163a888 with Priority: HIGHEST for action security_group_members [ 830.616112] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1bf27f4-91cf-44a6-8115-e3876163a888 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.616112] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.616112] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.616112] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.620545] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.620650] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.620722] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.620949] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.621077] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.621157] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e1bf27f4-91cf-44a6-8115-e3876163a888',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.626022] env[62842]: INFO networking_nsxv3.common.synchronization [req-0a1967ae-6803-460f-87fc-342ccc68b062 req-b80c72f6-94c5-4075-bf81-4a3081889965 tempest-ServerDiskConfigTestJSON-797549774 tempest-ServerDiskConfigTestJSON-797549774-project-member] Enqueued Resource ID: c184a589-476a-49bd-9984-d339a77ec8f3 with Priority: HIGHEST for action security_group_members [ 830.626022] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c184a589-476a-49bd-9984-d339a77ec8f3 with Priority: HIGHEST for action security_group_members [ 830.628402] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-c184a589-476a-49bd-9984-d339a77ec8f3 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.628961] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.629107] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.629301] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.629461] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.629556] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.629617] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.629760] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.629839] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.629949] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c184a589-476a-49bd-9984-d339a77ec8f3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.846691] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('35146777-fd28-4ac7-b454-f7dd3fbb5846',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.118466] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-51 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.118725] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-51" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.118862] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-51" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.119386] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-51" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.119708] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.119885] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.120186] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.120459] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.120618] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.120836] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 831.121033] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 831.121174] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 831.121294] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 831.121484] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 831.121530] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 831.121667] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 831.125100] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.125215] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.125284] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.125460] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.132492] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.132601] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.153485] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 831.153682] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 831.153832] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 831.154080] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-51" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.154429] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-26319295-d322-4aed-b1bb-2a3169462c2e taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.154626] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-26319295-d322-4aed-b1bb-2a3169462c2e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.154759] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-26319295-d322-4aed-b1bb-2a3169462c2e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.155478] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-26319295-d322-4aed-b1bb-2a3169462c2e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.155478] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26319295-d322-4aed-b1bb-2a3169462c2e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.158092] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.158092] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.158092] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.158092] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.158092] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.158092] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.158092] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1bf27f4-91cf-44a6-8115-e3876163a888 is going to be updated. [ 831.159195] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.159195] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.159343] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.159477] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.159598] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.159661] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.159810] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.159888] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.159999] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c184a589-476a-49bd-9984-d339a77ec8f3 already deleted. [ 831.160099] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.188596] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.188728] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.188791] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.189092] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.189304] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.201759] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1bf27f4-91cf-44a6-8115-e3876163a888 in Status: IN_PROGRESS for 2s [ 831.349272] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.349489] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.349600] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.349873] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.350077] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.350189] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 is going to be created. [ 831.362823] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb447582-c572-481b-befa-98a3dcf064c3 in Status: SUCCESS [ 831.363023] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb447582-c572-481b-befa-98a3dcf064c3 deletion is rescheduled due to dependency. [ 831.363173] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb447582-c572-481b-befa-98a3dcf064c3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.376332] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.376568] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.376568] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.376758] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.376935] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.387367] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 in Status: UNINITIALIZED for 2s [ 831.625499] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 017b2ee9-30e5-4870-86c3-53c03de20d66 in Status: SUCCESS [ 831.625808] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 017b2ee9-30e5-4870-86c3-53c03de20d66 deletion is rescheduled due to dependency. [ 831.625808] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-017b2ee9-30e5-4870-86c3-53c03de20d66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.665018] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.665018] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.665018] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.665018] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.665018] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.665018] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 26319295-d322-4aed-b1bb-2a3169462c2e not found, creating... [ 831.665018] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.665018] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.665018] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.665018] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.665018] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.665488] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.665488] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.665488] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.665488] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.665488] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.665674] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 26319295-d322-4aed-b1bb-2a3169462c2e is going to be created. [ 831.686898] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.687132] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.687272] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.687524] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.687762] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.688620] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-26319295-d322-4aed-b1bb-2a3169462c2e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.484536] env[62842]: INFO networking_nsxv3.common.synchronization [req-0a1967ae-6803-460f-87fc-342ccc68b062 req-dd35198e-5b2f-4823-976e-c75d06b1e8d4 service nova] Enqueued Resource ID: c184a589-476a-49bd-9984-d339a77ec8f3 with Priority: HIGHEST for action security_group_rules [ 832.484733] env[62842]: INFO networking_nsxv3.common.synchronization [req-0a1967ae-6803-460f-87fc-342ccc68b062 req-dd35198e-5b2f-4823-976e-c75d06b1e8d4 service nova] Enqueued Resource ID: c184a589-476a-49bd-9984-d339a77ec8f3 with Priority: HIGHEST for action security_group_members [ 832.484959] env[62842]: INFO networking_nsxv3.common.synchronization [req-0a1967ae-6803-460f-87fc-342ccc68b062 req-dd35198e-5b2f-4823-976e-c75d06b1e8d4 service nova] Enqueued Resource ID: 26319295-d322-4aed-b1bb-2a3169462c2e with Priority: HIGHEST for action port [ 832.485227] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c184a589-476a-49bd-9984-d339a77ec8f3 with Priority: HIGHEST for action security_group_rules [ 832.485354] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c184a589-476a-49bd-9984-d339a77ec8f3 with Priority: HIGHEST for action security_group_members [ 832.485449] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26319295-d322-4aed-b1bb-2a3169462c2e with Priority: HIGHEST for action port [ 832.486231] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c184a589-476a-49bd-9984-d339a77ec8f3 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.486423] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.486511] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.486796] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.487024] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c184a589-476a-49bd-9984-d339a77ec8f3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.487853] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-c184a589-476a-49bd-9984-d339a77ec8f3 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.488161] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.488238] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.492188] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.492525] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.492525] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.492525] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.492675] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.492675] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.492752] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c184a589-476a-49bd-9984-d339a77ec8f3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.494142] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-26319295-d322-4aed-b1bb-2a3169462c2e taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.494261] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-26319295-d322-4aed-b1bb-2a3169462c2e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.494327] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-26319295-d322-4aed-b1bb-2a3169462c2e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.494493] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-26319295-d322-4aed-b1bb-2a3169462c2e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.494563] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26319295-d322-4aed-b1bb-2a3169462c2e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.996458] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c184a589-476a-49bd-9984-d339a77ec8f3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.998239] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-c184a589-476a-49bd-9984-d339a77ec8f3 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.998382] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.998573] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 26319295-d322-4aed-b1bb-2a3169462c2e with status ACTIVE [ 832.998745] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.998869] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.998927] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.000176] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.000176] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.000176] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.000176] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.000176] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.000176] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.000176] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.000176] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.000474] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.000474] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.000474] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.000548] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.000627] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 26319295-d322-4aed-b1bb-2a3169462c2e is going to be updated. [ 833.026009] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.026186] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.026259] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.026487] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.026665] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.026802] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-26319295-d322-4aed-b1bb-2a3169462c2e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.213385] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1bf27f4-91cf-44a6-8115-e3876163a888 in Status: SUCCESS [ 833.213708] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1bf27f4-91cf-44a6-8115-e3876163a888 deletion is rescheduled due to dependency. [ 833.213780] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.397512] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 in Status: SUCCESS [ 833.397784] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.398014] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.398234] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.398500] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.398587] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.398627] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.398759] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.398820] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.398906] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.399031] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('35146777-fd28-4ac7-b454-f7dd3fbb5846',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.503133] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c184a589-476a-49bd-9984-d339a77ec8f3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.903891] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-35146777-fd28-4ac7-b454-f7dd3fbb5846 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.903891] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.903891] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.903891] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.903891] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.903891] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.903891] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.903891] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.904805] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.904805] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.904805] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-35146777-fd28-4ac7-b454-f7dd3fbb5846 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.904805] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.904805] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.905281] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.905281] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.905281] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.905281] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.905447] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.905505] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.905830] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.905830] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('35146777-fd28-4ac7-b454-f7dd3fbb5846',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.008932] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.009274] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.009274] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.009401] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.009489] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.009591] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c184a589-476a-49bd-9984-d339a77ec8f3 is going to be created. [ 834.034245] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.034392] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.034392] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.034667] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.034841] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.045392] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c184a589-476a-49bd-9984-d339a77ec8f3 in Status: UNINITIALIZED for 2s [ 834.408588] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 35146777-fd28-4ac7-b454-f7dd3fbb5846: rpc.has_security_group_logging(os_id): False [ 834.430720] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.430957] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.430957] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.431150] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.436208] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.436439] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.436727] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.436727] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.436849] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.436918] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.437152] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.437247] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.437307] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.437456] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.437531] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.437715] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.437811] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.437894] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.438142] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.438216] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.438304] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 is going to be created. [ 834.509134] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.509345] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.509419] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.509641] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.509824] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.525306] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 in Status: IN_PROGRESS for 2s [ 835.161466] env[62842]: INFO networking_nsxv3.common.synchronization [req-cc2f960a-ce26-44ab-a6ec-fcb9ef949061 req-42ee4c89-30a7-4adf-83b6-1240efaa7e68 tempest-ServersWithSpecificFlavorTestJSON-2019624802 tempest-ServersWithSpecificFlavorTestJSON-2019624802-project-member] Enqueued Resource ID: 16baecd6-bda3-40e1-98ef-4e238a3fc354 with Priority: HIGHEST for action security_group_members [ 835.162136] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16baecd6-bda3-40e1-98ef-4e238a3fc354 with Priority: HIGHEST for action security_group_members [ 835.162475] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-16baecd6-bda3-40e1-98ef-4e238a3fc354 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.162604] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16baecd6-bda3-40e1-98ef-4e238a3fc354" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.162662] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16baecd6-bda3-40e1-98ef-4e238a3fc354" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.162860] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16baecd6-bda3-40e1-98ef-4e238a3fc354" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.163113] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.163227] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.163286] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.163440] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.166068] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.166068] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16baecd6-bda3-40e1-98ef-4e238a3fc354',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.665306] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.665484] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.665556] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.665911] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.665911] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.666125] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.666228] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.666277] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.666445] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.666517] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.666604] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16baecd6-bda3-40e1-98ef-4e238a3fc354 is going to be updated. [ 835.680975] env[62842]: INFO networking_nsxv3.common.synchronization [req-2a38cc99-81f6-44f8-b442-3d581e83cbd6 req-1e406b0a-9f8f-43f1-8632-cd53686ee6ed tempest-ServersAdminTestJSON-1475908229 tempest-ServersAdminTestJSON-1475908229-project-member] Enqueued Resource ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e with Priority: HIGHEST for action security_group_members [ 835.681506] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e with Priority: HIGHEST for action security_group_members [ 835.681834] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.681957] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.682036] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.682301] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.682510] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.682620] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.682667] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.682846] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.683062] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.683062] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7acb0f4-6157-4a0c-977e-ee6a2808aa0e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.783610] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.783777] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.783833] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.784046] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.784196] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.795777] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-927 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.796654] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-927" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.796654] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-927" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.796654] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-927" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.796654] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.796854] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.796896] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.798030] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.798030] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.798030] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 835.798030] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 835.798030] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 835.798030] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 835.798030] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 835.798030] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 835.798332] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 835.799906] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16baecd6-bda3-40e1-98ef-4e238a3fc354 in Status: IN_PROGRESS for 2s [ 835.821203] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 835.821612] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 835.821612] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 835.821740] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-927" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.822086] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-262e7d28-1651-4e63-bc6d-50608ee91a5e taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.822349] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-262e7d28-1651-4e63-bc6d-50608ee91a5e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.822454] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-262e7d28-1651-4e63-bc6d-50608ee91a5e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.822774] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-262e7d28-1651-4e63-bc6d-50608ee91a5e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.823034] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('262e7d28-1651-4e63-bc6d-50608ee91a5e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.055467] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c184a589-476a-49bd-9984-d339a77ec8f3 in Status: SUCCESS [ 836.055701] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.055864] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.056119] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.056316] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.056431] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.056497] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.056645] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.056726] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.056818] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.056898] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c184a589-476a-49bd-9984-d339a77ec8f3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.185406] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e7acb0f4-6157-4a0c-977e-ee6a2808aa0e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.329359] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.329780] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.329780] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.330368] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.330368] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.330562] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 262e7d28-1651-4e63-bc6d-50608ee91a5e not found, creating... [ 836.331160] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.331377] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.331494] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.331751] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.331922] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.332265] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.332411] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.332533] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.332810] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.332902] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.333060] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 262e7d28-1651-4e63-bc6d-50608ee91a5e is going to be created. [ 836.352628] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.352849] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.352972] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.353262] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.353493] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.353718] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-262e7d28-1651-4e63-bc6d-50608ee91a5e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.544073] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 in Status: SUCCESS [ 836.544314] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.558983] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-c184a589-476a-49bd-9984-d339a77ec8f3 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.559140] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.559364] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.559506] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.559728] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.559881] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.559980] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.560238] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.560377] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.560521] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.560933] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-c184a589-476a-49bd-9984-d339a77ec8f3 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.560933] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.561058] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.561212] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.561394] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.561516] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.561626] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.561830] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.561957] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.562109] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.562296] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c184a589-476a-49bd-9984-d339a77ec8f3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.688538] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e7acb0f4-6157-4a0c-977e-ee6a2808aa0e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.067432] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c184a589-476a-49bd-9984-d339a77ec8f3: rpc.has_security_group_logging(os_id): False [ 837.086481] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.086636] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.086762] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.086925] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.087018] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.087249] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.087341] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.087404] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.087556] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.087624] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.087810] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.087931] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.087995] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.088151] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.088224] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.088410] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.088937] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.089107] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.089308] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.089411] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.089557] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c184a589-476a-49bd-9984-d339a77ec8f3 is going to be created. [ 837.094308] env[62842]: INFO networking_nsxv3.common.synchronization [req-cc2f960a-ce26-44ab-a6ec-fcb9ef949061 req-1ed13f56-bf78-47f8-a0fb-ba48f1dfb78e service nova] Enqueued Resource ID: 16baecd6-bda3-40e1-98ef-4e238a3fc354 with Priority: HIGHEST for action security_group_rules [ 837.094565] env[62842]: INFO networking_nsxv3.common.synchronization [req-cc2f960a-ce26-44ab-a6ec-fcb9ef949061 req-1ed13f56-bf78-47f8-a0fb-ba48f1dfb78e service nova] Enqueued Resource ID: 16baecd6-bda3-40e1-98ef-4e238a3fc354 with Priority: HIGHEST for action security_group_members [ 837.094757] env[62842]: INFO networking_nsxv3.common.synchronization [req-cc2f960a-ce26-44ab-a6ec-fcb9ef949061 req-1ed13f56-bf78-47f8-a0fb-ba48f1dfb78e service nova] Enqueued Resource ID: 262e7d28-1651-4e63-bc6d-50608ee91a5e with Priority: HIGHEST for action port [ 837.095835] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16baecd6-bda3-40e1-98ef-4e238a3fc354 with Priority: HIGHEST for action security_group_rules [ 837.096029] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16baecd6-bda3-40e1-98ef-4e238a3fc354 with Priority: HIGHEST for action security_group_members [ 837.096189] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 262e7d28-1651-4e63-bc6d-50608ee91a5e with Priority: HIGHEST for action port [ 837.096558] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16baecd6-bda3-40e1-98ef-4e238a3fc354 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.096713] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16baecd6-bda3-40e1-98ef-4e238a3fc354" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.096831] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16baecd6-bda3-40e1-98ef-4e238a3fc354" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.097146] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16baecd6-bda3-40e1-98ef-4e238a3fc354" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.097268] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16baecd6-bda3-40e1-98ef-4e238a3fc354',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.098395] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-16baecd6-bda3-40e1-98ef-4e238a3fc354 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.098968] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16baecd6-bda3-40e1-98ef-4e238a3fc354" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.099302] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-262e7d28-1651-4e63-bc6d-50608ee91a5e taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.102575] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-262e7d28-1651-4e63-bc6d-50608ee91a5e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.102575] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-262e7d28-1651-4e63-bc6d-50608ee91a5e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.102575] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-262e7d28-1651-4e63-bc6d-50608ee91a5e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.102575] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('262e7d28-1651-4e63-bc6d-50608ee91a5e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.154606] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.154766] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.155349] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.155349] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.155349] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.168141] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c184a589-476a-49bd-9984-d339a77ec8f3 in Status: IN_PROGRESS for 2s [ 837.193100] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.193100] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.193100] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.193100] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.193100] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.193100] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e is going to be updated. [ 837.225558] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.225704] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.225772] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.226088] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.226245] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.242703] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e in Status: IN_PROGRESS for 2s [ 837.338033] env[62842]: INFO networking_nsxv3.common.synchronization [None req-49d9f4ec-d838-4d31-9366-99b20f241459 None None] Enqueued Resource ID: 321cc09c-dd4f-4483-852f-50a63eb4b4f6 with Priority: HIGHEST for action port [ 837.338180] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 321cc09c-dd4f-4483-852f-50a63eb4b4f6 with Priority: HIGHEST for action port [ 837.339470] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-321cc09c-dd4f-4483-852f-50a63eb4b4f6 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.339470] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-321cc09c-dd4f-4483-852f-50a63eb4b4f6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.339651] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-321cc09c-dd4f-4483-852f-50a63eb4b4f6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.343291] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-321cc09c-dd4f-4483-852f-50a63eb4b4f6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.343429] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('321cc09c-dd4f-4483-852f-50a63eb4b4f6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.605019] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-16baecd6-bda3-40e1-98ef-4e238a3fc354 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.605019] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16baecd6-bda3-40e1-98ef-4e238a3fc354" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.605019] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 262e7d28-1651-4e63-bc6d-50608ee91a5e with status ACTIVE [ 837.605019] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.605019] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.605019] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.605019] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.605019] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.605019] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.605019] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.605019] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.605019] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.605019] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.605019] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.605673] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.605673] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.605673] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.605673] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.605673] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 262e7d28-1651-4e63-bc6d-50608ee91a5e is going to be updated. [ 837.634761] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.635330] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.636172] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.636172] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.636267] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.636602] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-262e7d28-1651-4e63-bc6d-50608ee91a5e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.816273] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16baecd6-bda3-40e1-98ef-4e238a3fc354 in Status: SUCCESS [ 837.816595] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16baecd6-bda3-40e1-98ef-4e238a3fc354 deletion is rescheduled due to dependency. [ 837.818370] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16baecd6-bda3-40e1-98ef-4e238a3fc354" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.818631] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16baecd6-bda3-40e1-98ef-4e238a3fc354" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.819213] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16baecd6-bda3-40e1-98ef-4e238a3fc354" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.819297] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.819641] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.819641] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.819815] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.819815] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.819910] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16baecd6-bda3-40e1-98ef-4e238a3fc354',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.846591] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 321cc09c-dd4f-4483-852f-50a63eb4b4f6 [ 837.846865] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.846946] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.846988] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.847261] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.847352] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.847447] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:321cc09c-dd4f-4483-852f-50a63eb4b4f6 already deleted. [ 837.847528] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-321cc09c-dd4f-4483-852f-50a63eb4b4f6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.323669] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('16baecd6-bda3-40e1-98ef-4e238a3fc354',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.423774] env[62842]: INFO networking_nsxv3.common.synchronization [None req-1eb9a766-40f8-4533-adb4-5ba4a264e1b8 tempest-AttachVolumeShelveTestJSON-759972748 tempest-AttachVolumeShelveTestJSON-759972748-project-member] Enqueued Resource ID: 15e06d0a-ad75-4e9d-b1a6-db54b2f524a4 with Priority: HIGHEST for action security_group_rules [ 838.423774] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15e06d0a-ad75-4e9d-b1a6-db54b2f524a4 with Priority: HIGHEST for action security_group_rules [ 838.424314] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.424314] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.424314] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.424669] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.424669] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15e06d0a-ad75-4e9d-b1a6-db54b2f524a4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.658108] env[62842]: INFO networking_nsxv3.common.synchronization [None req-3f0f722c-c1b6-4b67-8a93-ff3c552788a8 tempest-AttachVolumeShelveTestJSON-759972748 tempest-AttachVolumeShelveTestJSON-759972748-project-member] Enqueued Resource ID: 15e06d0a-ad75-4e9d-b1a6-db54b2f524a4 with Priority: HIGHEST for action security_group_rules [ 838.658108] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15e06d0a-ad75-4e9d-b1a6-db54b2f524a4 with Priority: HIGHEST for action security_group_rules [ 838.658108] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.658108] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.826314] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('16baecd6-bda3-40e1-98ef-4e238a3fc354',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.951584] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.951844] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.951844] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.952176] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.952176] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.952294] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15e06d0a-ad75-4e9d-b1a6-db54b2f524a4 already deleted. [ 838.952362] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.952516] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.952689] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.952779] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15e06d0a-ad75-4e9d-b1a6-db54b2f524a4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.186437] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c184a589-476a-49bd-9984-d339a77ec8f3 in Status: SUCCESS [ 839.186437] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.254155] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e in Status: SUCCESS [ 839.254405] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.334032] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.334032] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.334032] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.334032] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.334032] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.334032] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16baecd6-bda3-40e1-98ef-4e238a3fc354 is going to be updated. [ 839.367711] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.368043] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.368043] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.368157] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.368302] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.381662] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16baecd6-bda3-40e1-98ef-4e238a3fc354 in Status: IN_PROGRESS for 2s [ 839.479729] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.479924] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.479924] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.480477] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.480619] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.480899] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15e06d0a-ad75-4e9d-b1a6-db54b2f524a4 already deleted. [ 839.480972] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.874498] env[62842]: INFO networking_nsxv3.common.synchronization [None req-ac97ad88-aea1-4821-bf96-236d0857c165 None None] Enqueued Resource ID: 9688862b-07d2-4e10-b393-bcb1bc7b50f3 with Priority: HIGHEST for action port [ 839.874498] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9688862b-07d2-4e10-b393-bcb1bc7b50f3 with Priority: HIGHEST for action port [ 839.874602] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-9688862b-07d2-4e10-b393-bcb1bc7b50f3 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.875862] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9688862b-07d2-4e10-b393-bcb1bc7b50f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.875862] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9688862b-07d2-4e10-b393-bcb1bc7b50f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.875862] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9688862b-07d2-4e10-b393-bcb1bc7b50f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.875862] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9688862b-07d2-4e10-b393-bcb1bc7b50f3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.376964] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9688862b-07d2-4e10-b393-bcb1bc7b50f3 [ 840.377238] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.377374] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.377460] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.377681] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.377771] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.377883] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9688862b-07d2-4e10-b393-bcb1bc7b50f3 already deleted. [ 840.377986] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9688862b-07d2-4e10-b393-bcb1bc7b50f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.401687] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16baecd6-bda3-40e1-98ef-4e238a3fc354 in Status: SUCCESS [ 841.401687] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16baecd6-bda3-40e1-98ef-4e238a3fc354" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.402091] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16baecd6-bda3-40e1-98ef-4e238a3fc354" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.402137] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16baecd6-bda3-40e1-98ef-4e238a3fc354" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.402331] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.403776] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.403776] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.403776] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.403776] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.403776] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16baecd6-bda3-40e1-98ef-4e238a3fc354" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.403776] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('16baecd6-bda3-40e1-98ef-4e238a3fc354',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.908077] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('16baecd6-bda3-40e1-98ef-4e238a3fc354',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.352634] env[62842]: INFO networking_nsxv3.common.synchronization [None req-eccd13b6-6a57-4c7c-be70-f7d803bcc882 tempest-AttachVolumeNegativeTest-1420230652 tempest-AttachVolumeNegativeTest-1420230652-project-member] Enqueued Resource ID: 6588f3bb-b208-4ec7-8a50-1e573d683f24 with Priority: HIGHEST for action security_group_rules [ 842.353106] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6588f3bb-b208-4ec7-8a50-1e573d683f24 with Priority: HIGHEST for action security_group_rules [ 842.353739] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6588f3bb-b208-4ec7-8a50-1e573d683f24 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.353869] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6588f3bb-b208-4ec7-8a50-1e573d683f24" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.353940] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6588f3bb-b208-4ec7-8a50-1e573d683f24" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.354461] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6588f3bb-b208-4ec7-8a50-1e573d683f24" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.354461] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6588f3bb-b208-4ec7-8a50-1e573d683f24',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.413079] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 16baecd6-bda3-40e1-98ef-4e238a3fc354: rpc.has_security_group_logging(os_id): False [ 842.432842] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.433051] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.433095] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.433298] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.433394] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.433639] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.433753] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.433831] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.433961] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.434153] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.434153] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16baecd6-bda3-40e1-98ef-4e238a3fc354 is going to be updated. [ 842.470928] env[62842]: INFO networking_nsxv3.common.synchronization [None req-2b79d625-9921-4294-9d96-36b4c0ed2fda tempest-AttachVolumeNegativeTest-1420230652 tempest-AttachVolumeNegativeTest-1420230652-project-member] Enqueued Resource ID: 6588f3bb-b208-4ec7-8a50-1e573d683f24 with Priority: HIGHEST for action security_group_rules [ 842.470928] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6588f3bb-b208-4ec7-8a50-1e573d683f24 with Priority: HIGHEST for action security_group_rules [ 842.471236] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6588f3bb-b208-4ec7-8a50-1e573d683f24 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.471495] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6588f3bb-b208-4ec7-8a50-1e573d683f24" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.500091] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.500272] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.500346] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.500595] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.500752] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.516019] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16baecd6-bda3-40e1-98ef-4e238a3fc354 in Status: IN_PROGRESS for 2s [ 842.877126] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.877243] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.877280] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.877481] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.877570] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.877665] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6588f3bb-b208-4ec7-8a50-1e573d683f24 already deleted. [ 842.877750] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6588f3bb-b208-4ec7-8a50-1e573d683f24" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.877936] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6588f3bb-b208-4ec7-8a50-1e573d683f24" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.878233] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6588f3bb-b208-4ec7-8a50-1e573d683f24" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.878343] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6588f3bb-b208-4ec7-8a50-1e573d683f24',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.145145] env[62842]: INFO networking_nsxv3.common.synchronization [req-7d19d936-2d69-4b11-99d0-db25c1ab1117 req-11f606df-c263-4d37-95f2-95a478ba80bd tempest-MigrationsAdminTest-2116750055 tempest-MigrationsAdminTest-2116750055-project-member] Enqueued Resource ID: 38b4d382-6400-4588-b620-faecfba1fd64 with Priority: HIGHEST for action security_group_members [ 843.146654] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38b4d382-6400-4588-b620-faecfba1fd64 with Priority: HIGHEST for action security_group_members [ 843.146654] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-38b4d382-6400-4588-b620-faecfba1fd64 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.146654] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.146654] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.146905] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.146905] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.147021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.147063] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.147248] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.147364] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.147496] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38b4d382-6400-4588-b620-faecfba1fd64',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.406049] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.406205] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.406278] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.406491] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.406579] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.406669] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6588f3bb-b208-4ec7-8a50-1e573d683f24 already deleted. [ 843.406776] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6588f3bb-b208-4ec7-8a50-1e573d683f24" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.650108] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.650468] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.650468] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.650776] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.676058] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.676399] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.676565] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.676691] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.680300] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.680433] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.680573] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38b4d382-6400-4588-b620-faecfba1fd64 is going to be updated. [ 843.717849] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.718111] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.718179] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.718393] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.718555] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.729959] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38b4d382-6400-4588-b620-faecfba1fd64 in Status: IN_PROGRESS for 2s [ 844.532451] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16baecd6-bda3-40e1-98ef-4e238a3fc354 in Status: SUCCESS [ 844.532681] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16baecd6-bda3-40e1-98ef-4e238a3fc354" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.744664] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38b4d382-6400-4588-b620-faecfba1fd64 in Status: SUCCESS [ 845.744664] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38b4d382-6400-4588-b620-faecfba1fd64 deletion is rescheduled due to dependency. [ 845.744664] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.147701] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 848.148090] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 853.149270] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 853.149270] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 853.843104] env[62842]: INFO networking_nsxv3.common.synchronization [req-1b019854-54ca-44a2-b734-23d0d8455720 req-f3cce776-da73-4574-a02a-65aeb3157d4e tempest-AttachInterfacesUnderV243Test-764117880 tempest-AttachInterfacesUnderV243Test-764117880-project-member] Enqueued Resource ID: 83478649-c10f-45af-9cd9-d412883cd575 with Priority: HIGHEST for action security_group_members [ 853.843632] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83478649-c10f-45af-9cd9-d412883cd575 with Priority: HIGHEST for action security_group_members [ 853.847017] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-83478649-c10f-45af-9cd9-d412883cd575 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.847017] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83478649-c10f-45af-9cd9-d412883cd575" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.847017] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83478649-c10f-45af-9cd9-d412883cd575" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.847017] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83478649-c10f-45af-9cd9-d412883cd575" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.847017] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.847017] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.847017] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.847017] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.847017] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.847017] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83478649-c10f-45af-9cd9-d412883cd575',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.881770] env[62842]: INFO networking_nsxv3.common.synchronization [req-1b019854-54ca-44a2-b734-23d0d8455720 req-f3cce776-da73-4574-a02a-65aeb3157d4e tempest-AttachInterfacesUnderV243Test-764117880 tempest-AttachInterfacesUnderV243Test-764117880-project-member] Enqueued Resource ID: 83478649-c10f-45af-9cd9-d412883cd575 with Priority: HIGHEST for action security_group_rules [ 853.882028] env[62842]: INFO networking_nsxv3.common.synchronization [req-1b019854-54ca-44a2-b734-23d0d8455720 req-f3cce776-da73-4574-a02a-65aeb3157d4e tempest-AttachInterfacesUnderV243Test-764117880 tempest-AttachInterfacesUnderV243Test-764117880-project-member] Enqueued Resource ID: 83478649-c10f-45af-9cd9-d412883cd575 with Priority: HIGHEST for action security_group_members [ 853.882192] env[62842]: INFO networking_nsxv3.common.synchronization [req-1b019854-54ca-44a2-b734-23d0d8455720 req-f3cce776-da73-4574-a02a-65aeb3157d4e tempest-AttachInterfacesUnderV243Test-764117880 tempest-AttachInterfacesUnderV243Test-764117880-project-member] Enqueued Resource ID: da77ac4f-85e3-4f62-8133-70d8204acf94 with Priority: HIGHEST for action port [ 853.882745] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83478649-c10f-45af-9cd9-d412883cd575 with Priority: HIGHEST for action security_group_rules [ 853.883675] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83478649-c10f-45af-9cd9-d412883cd575 with Priority: HIGHEST for action security_group_members [ 853.883675] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da77ac4f-85e3-4f62-8133-70d8204acf94 with Priority: HIGHEST for action port [ 853.883675] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-83478649-c10f-45af-9cd9-d412883cd575 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.883675] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-83478649-c10f-45af-9cd9-d412883cd575" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.883675] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-83478649-c10f-45af-9cd9-d412883cd575" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.883937] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-83478649-c10f-45af-9cd9-d412883cd575" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.884056] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('83478649-c10f-45af-9cd9-d412883cd575',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.885363] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-83478649-c10f-45af-9cd9-d412883cd575 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.885495] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83478649-c10f-45af-9cd9-d412883cd575" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.885802] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-da77ac4f-85e3-4f62-8133-70d8204acf94 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.885891] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-da77ac4f-85e3-4f62-8133-70d8204acf94" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.885923] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-da77ac4f-85e3-4f62-8133-70d8204acf94" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.886884] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-da77ac4f-85e3-4f62-8133-70d8204acf94" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.886884] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da77ac4f-85e3-4f62-8133-70d8204acf94',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.351740] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('83478649-c10f-45af-9cd9-d412883cd575',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.390336] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-83478649-c10f-45af-9cd9-d412883cd575 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.390336] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83478649-c10f-45af-9cd9-d412883cd575" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.394090] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port da77ac4f-85e3-4f62-8133-70d8204acf94 with status ACTIVE [ 854.394704] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.394704] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.394704] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.394869] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.394939] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.395220] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.395337] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.395418] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.395619] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.395717] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.395924] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.396076] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.396174] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.396416] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.396506] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.396595] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: da77ac4f-85e3-4f62-8133-70d8204acf94 is going to be updated. [ 854.430822] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.431471] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.431471] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.434550] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.434762] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.434993] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-da77ac4f-85e3-4f62-8133-70d8204acf94" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.855606] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('83478649-c10f-45af-9cd9-d412883cd575',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.129552] env[62842]: INFO networking_nsxv3.common.synchronization [req-fe96f301-02d8-404e-a7f5-a93edcd146d2 req-4b9bf026-7b81-47e6-ab58-76759efd1b12 tempest-ServerDiskConfigTestJSON-797549774 tempest-ServerDiskConfigTestJSON-797549774-project-member] Enqueued Resource ID: c184a589-476a-49bd-9984-d339a77ec8f3 with Priority: HIGHEST for action security_group_members [ 855.133651] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c184a589-476a-49bd-9984-d339a77ec8f3 with Priority: HIGHEST for action security_group_members [ 855.133651] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-c184a589-476a-49bd-9984-d339a77ec8f3 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.133651] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.133651] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.133651] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.133651] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.133651] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.133651] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.133651] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.133651] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.133651] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c184a589-476a-49bd-9984-d339a77ec8f3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.359610] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.365450] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.365450] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.365450] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.365450] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.365450] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83478649-c10f-45af-9cd9-d412883cd575 is going to be updated. [ 855.396955] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.396955] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.397234] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.397565] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.397565] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.409646] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83478649-c10f-45af-9cd9-d412883cd575 in Status: IN_PROGRESS for 2s [ 855.635563] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.635728] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.635800] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.636034] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.636134] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.636428] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.636428] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.636531] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.636633] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.636702] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.636790] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c184a589-476a-49bd-9984-d339a77ec8f3 is going to be updated. [ 855.672260] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.672570] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.672694] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.672827] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.672998] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.683889] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c184a589-476a-49bd-9984-d339a77ec8f3 in Status: IN_PROGRESS for 2s [ 855.990362] env[62842]: INFO networking_nsxv3.common.synchronization [req-f68ec1fd-2ea9-417c-b405-6854e8d5b34d req-3ee13089-dd7c-486c-9a82-f273a4d01e56 tempest-ServersAdminTestJSON-1475908229 tempest-ServersAdminTestJSON-1475908229-project-member] Enqueued Resource ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e with Priority: HIGHEST for action security_group_members [ 855.990919] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e with Priority: HIGHEST for action security_group_members [ 855.991286] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.991635] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.991635] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.991733] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.991840] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.991937] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.991998] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.992159] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.992243] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.992337] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7acb0f4-6157-4a0c-977e-ee6a2808aa0e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.494903] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e7acb0f4-6157-4a0c-977e-ee6a2808aa0e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.591366] env[62842]: INFO networking_nsxv3.common.synchronization [req-ae5064bc-0a71-423e-9d96-f1b5c5aba2ea req-8c81d1eb-0f56-4161-8672-13d381fa8a56 tempest-InstanceActionsTestJSON-1995068943 tempest-InstanceActionsTestJSON-1995068943-project-member] Enqueued Resource ID: 437e64e0-ea9a-4d6f-88a7-838a0318993c with Priority: HIGHEST for action security_group_members [ 856.591594] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 437e64e0-ea9a-4d6f-88a7-838a0318993c with Priority: HIGHEST for action security_group_members [ 856.591886] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-437e64e0-ea9a-4d6f-88a7-838a0318993c taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.592015] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-437e64e0-ea9a-4d6f-88a7-838a0318993c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.592119] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-437e64e0-ea9a-4d6f-88a7-838a0318993c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.592773] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-437e64e0-ea9a-4d6f-88a7-838a0318993c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.592773] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.592773] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.592773] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.593081] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.593081] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.593081] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('437e64e0-ea9a-4d6f-88a7-838a0318993c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.997570] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e7acb0f4-6157-4a0c-977e-ee6a2808aa0e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.098136] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.098571] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.098571] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.098712] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.098813] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.099126] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.099237] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.099318] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.099512] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.099596] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.099681] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 437e64e0-ea9a-4d6f-88a7-838a0318993c already deleted. [ 857.099758] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-437e64e0-ea9a-4d6f-88a7-838a0318993c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.106603] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-25 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.106794] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-25" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.106920] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-25" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.107290] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-25" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.107572] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.107733] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.107853] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.108551] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.108706] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.109384] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 857.109664] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 857.110152] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 857.110322] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 857.110448] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 857.110562] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 857.110704] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 857.133078] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 857.133270] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 857.133424] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 857.133601] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-25" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.134312] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-c0d05d08-140f-4c25-94a8-ca227d6c4445 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.134520] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-c0d05d08-140f-4c25-94a8-ca227d6c4445" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.134646] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-c0d05d08-140f-4c25-94a8-ca227d6c4445" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.134980] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-c0d05d08-140f-4c25-94a8-ca227d6c4445" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.135142] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0d05d08-140f-4c25-94a8-ca227d6c4445',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.421575] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83478649-c10f-45af-9cd9-d412883cd575 in Status: SUCCESS [ 857.421982] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83478649-c10f-45af-9cd9-d412883cd575" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.422564] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83478649-c10f-45af-9cd9-d412883cd575" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.423033] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83478649-c10f-45af-9cd9-d412883cd575" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.423033] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.423202] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.423202] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.423474] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.423474] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.423560] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83478649-c10f-45af-9cd9-d412883cd575',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.427115] env[62842]: INFO networking_nsxv3.common.synchronization [None req-6bf142da-38b1-4a06-81a4-97c9e4ec5ede None None] Enqueued Resource ID: a1f5f678-0f75-4ad0-91c0-9ce9c7c18b4a with Priority: HIGHEST for action port [ 857.436018] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1f5f678-0f75-4ad0-91c0-9ce9c7c18b4a with Priority: HIGHEST for action port [ 857.436018] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1f5f678-0f75-4ad0-91c0-9ce9c7c18b4a taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.436018] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1f5f678-0f75-4ad0-91c0-9ce9c7c18b4a" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.436018] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1f5f678-0f75-4ad0-91c0-9ce9c7c18b4a" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.436018] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1f5f678-0f75-4ad0-91c0-9ce9c7c18b4a" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.436018] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1f5f678-0f75-4ad0-91c0-9ce9c7c18b4a',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.500479] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.500875] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.500875] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.501067] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.501173] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.501299] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e is going to be updated. [ 857.533446] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.533744] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.533835] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.534105] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.534284] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.544397] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e in Status: IN_PROGRESS for 2s [ 857.638012] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.638305] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.638468] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.638791] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.638970] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.639162] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port c0d05d08-140f-4c25-94a8-ca227d6c4445 not found, creating... [ 857.639458] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.639640] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.639765] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.640035] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.640282] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.640583] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.640745] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.640862] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.641774] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.641987] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.642203] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: c0d05d08-140f-4c25-94a8-ca227d6c4445 is going to be created. [ 857.673889] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.674168] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.674270] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.674564] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.674805] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.675062] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-c0d05d08-140f-4c25-94a8-ca227d6c4445" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.695041] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c184a589-476a-49bd-9984-d339a77ec8f3 in Status: SUCCESS [ 857.695258] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c184a589-476a-49bd-9984-d339a77ec8f3 deletion is rescheduled due to dependency. [ 857.695394] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.762116] env[62842]: INFO networking_nsxv3.common.synchronization [req-cfd7c905-56a5-4ad2-9c1f-fb8381d59888 req-26a87da1-7c40-473b-9a87-abaf0faa8703 tempest-AttachInterfacesUnderV243Test-764117880 tempest-AttachInterfacesUnderV243Test-764117880-project-member] Enqueued Resource ID: 83478649-c10f-45af-9cd9-d412883cd575 with Priority: HIGHEST for action security_group_members [ 857.763077] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83478649-c10f-45af-9cd9-d412883cd575 with Priority: HIGHEST for action security_group_members [ 857.763547] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-83478649-c10f-45af-9cd9-d412883cd575 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.763719] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83478649-c10f-45af-9cd9-d412883cd575" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.786794] env[62842]: INFO networking_nsxv3.common.synchronization [req-cfd7c905-56a5-4ad2-9c1f-fb8381d59888 req-26a87da1-7c40-473b-9a87-abaf0faa8703 tempest-AttachInterfacesUnderV243Test-764117880 tempest-AttachInterfacesUnderV243Test-764117880-project-member] Enqueued Resource ID: 83478649-c10f-45af-9cd9-d412883cd575 with Priority: HIGHEST for action security_group_rules [ 857.786794] env[62842]: INFO networking_nsxv3.common.synchronization [req-cfd7c905-56a5-4ad2-9c1f-fb8381d59888 req-26a87da1-7c40-473b-9a87-abaf0faa8703 tempest-AttachInterfacesUnderV243Test-764117880 tempest-AttachInterfacesUnderV243Test-764117880-project-member] Enqueued Resource ID: 83478649-c10f-45af-9cd9-d412883cd575 with Priority: HIGHEST for action security_group_members [ 857.786794] env[62842]: INFO networking_nsxv3.common.synchronization [req-cfd7c905-56a5-4ad2-9c1f-fb8381d59888 req-26a87da1-7c40-473b-9a87-abaf0faa8703 tempest-AttachInterfacesUnderV243Test-764117880 tempest-AttachInterfacesUnderV243Test-764117880-project-member] Enqueued Resource ID: da77ac4f-85e3-4f62-8133-70d8204acf94 with Priority: HIGHEST for action port [ 857.786794] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83478649-c10f-45af-9cd9-d412883cd575 with Priority: HIGHEST for action security_group_rules [ 857.786794] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83478649-c10f-45af-9cd9-d412883cd575 with Priority: HIGHEST for action security_group_members [ 857.786794] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da77ac4f-85e3-4f62-8133-70d8204acf94 with Priority: HIGHEST for action port [ 857.786794] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-83478649-c10f-45af-9cd9-d412883cd575 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.786794] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-83478649-c10f-45af-9cd9-d412883cd575" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.786794] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-83478649-c10f-45af-9cd9-d412883cd575 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.786794] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83478649-c10f-45af-9cd9-d412883cd575" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.786794] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-da77ac4f-85e3-4f62-8133-70d8204acf94 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.786794] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-da77ac4f-85e3-4f62-8133-70d8204acf94" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.786794] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-da77ac4f-85e3-4f62-8133-70d8204acf94" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.786794] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-da77ac4f-85e3-4f62-8133-70d8204acf94" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.786794] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da77ac4f-85e3-4f62-8133-70d8204acf94',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.929928] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('83478649-c10f-45af-9cd9-d412883cd575',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.936091] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a1f5f678-0f75-4ad0-91c0-9ce9c7c18b4a [ 857.936091] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.936091] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.936091] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.936257] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.936331] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.936470] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a1f5f678-0f75-4ad0-91c0-9ce9c7c18b4a already deleted. [ 857.936574] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1f5f678-0f75-4ad0-91c0-9ce9c7c18b4a" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.291017] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port da77ac4f-85e3-4f62-8133-70d8204acf94 with status ACTIVE [ 858.291017] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.291017] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.291017] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.291017] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.291017] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.291017] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.291017] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.291017] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.291017] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.291017] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.291017] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.291017] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.291017] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.291017] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.291017] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.291017] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: da77ac4f-85e3-4f62-8133-70d8204acf94 is going to be updated. [ 858.319023] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.319261] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.319394] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.319650] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.319843] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.320064] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-da77ac4f-85e3-4f62-8133-70d8204acf94" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.432996] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('83478649-c10f-45af-9cd9-d412883cd575',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.936231] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.936231] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.936231] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.936231] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.936231] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.936231] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83478649-c10f-45af-9cd9-d412883cd575 is going to be updated. [ 858.969185] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.969185] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.969185] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.969185] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.969185] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.989030] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83478649-c10f-45af-9cd9-d412883cd575 in Status: IN_PROGRESS for 2s [ 859.039822] env[62842]: INFO networking_nsxv3.common.synchronization [req-ae5064bc-0a71-423e-9d96-f1b5c5aba2ea req-397888b3-a578-4b46-bdaa-5826e7c6c0b5 service nova] Enqueued Resource ID: 437e64e0-ea9a-4d6f-88a7-838a0318993c with Priority: HIGHEST for action security_group_rules [ 859.039985] env[62842]: INFO networking_nsxv3.common.synchronization [req-ae5064bc-0a71-423e-9d96-f1b5c5aba2ea req-397888b3-a578-4b46-bdaa-5826e7c6c0b5 service nova] Enqueued Resource ID: 437e64e0-ea9a-4d6f-88a7-838a0318993c with Priority: HIGHEST for action security_group_members [ 859.040096] env[62842]: INFO networking_nsxv3.common.synchronization [req-ae5064bc-0a71-423e-9d96-f1b5c5aba2ea req-397888b3-a578-4b46-bdaa-5826e7c6c0b5 service nova] Enqueued Resource ID: c0d05d08-140f-4c25-94a8-ca227d6c4445 with Priority: HIGHEST for action port [ 859.040760] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 437e64e0-ea9a-4d6f-88a7-838a0318993c with Priority: HIGHEST for action security_group_rules [ 859.040902] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 437e64e0-ea9a-4d6f-88a7-838a0318993c with Priority: HIGHEST for action security_group_members [ 859.040999] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0d05d08-140f-4c25-94a8-ca227d6c4445 with Priority: HIGHEST for action port [ 859.041965] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-437e64e0-ea9a-4d6f-88a7-838a0318993c taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.042223] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-437e64e0-ea9a-4d6f-88a7-838a0318993c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.042223] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-437e64e0-ea9a-4d6f-88a7-838a0318993c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.042589] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-437e64e0-ea9a-4d6f-88a7-838a0318993c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.042670] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('437e64e0-ea9a-4d6f-88a7-838a0318993c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.043615] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-437e64e0-ea9a-4d6f-88a7-838a0318993c taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.044334] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-437e64e0-ea9a-4d6f-88a7-838a0318993c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.044334] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-437e64e0-ea9a-4d6f-88a7-838a0318993c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.044334] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-437e64e0-ea9a-4d6f-88a7-838a0318993c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.044334] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.044334] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.044334] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.044755] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.044755] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.044755] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('437e64e0-ea9a-4d6f-88a7-838a0318993c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.045924] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-c0d05d08-140f-4c25-94a8-ca227d6c4445 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.045924] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c0d05d08-140f-4c25-94a8-ca227d6c4445" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.045924] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c0d05d08-140f-4c25-94a8-ca227d6c4445" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.046366] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c0d05d08-140f-4c25-94a8-ca227d6c4445" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.046366] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0d05d08-140f-4c25-94a8-ca227d6c4445',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.322892] env[62842]: INFO networking_nsxv3.common.synchronization [req-054ac95a-4f72-4895-a8b3-d291878b31a5 req-d56c68f4-b10d-4c87-b11e-d78e56f4dcaf tempest-AttachVolumeShelveTestJSON-759972748 tempest-AttachVolumeShelveTestJSON-759972748-project-member] Enqueued Resource ID: 15e06d0a-ad75-4e9d-b1a6-db54b2f524a4 with Priority: HIGHEST for action security_group_members [ 859.323978] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15e06d0a-ad75-4e9d-b1a6-db54b2f524a4 with Priority: HIGHEST for action security_group_members [ 859.324140] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.324316] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.324376] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.324631] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.325180] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.325180] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.325180] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.325180] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.326845] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.329096] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15e06d0a-ad75-4e9d-b1a6-db54b2f524a4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.548920] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-437e64e0-ea9a-4d6f-88a7-838a0318993c taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.548920] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-437e64e0-ea9a-4d6f-88a7-838a0318993c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.548920] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('437e64e0-ea9a-4d6f-88a7-838a0318993c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.549266] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c0d05d08-140f-4c25-94a8-ca227d6c4445 with status ACTIVE [ 859.549452] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.549562] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.549626] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.549825] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.549909] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.550093] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.550291] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.550397] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.550598] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.550679] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.551188] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.553162] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.553162] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.553162] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.553162] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.553162] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c0d05d08-140f-4c25-94a8-ca227d6c4445 is going to be updated. [ 859.555502] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e in Status: SUCCESS [ 859.555661] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.576383] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.576568] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.576619] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.576813] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.576950] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.577122] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c0d05d08-140f-4c25-94a8-ca227d6c4445" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.832251] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.832592] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.832592] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.832838] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.832985] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.837028] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.837028] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.837028] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.837028] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.837028] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.837028] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15e06d0a-ad75-4e9d-b1a6-db54b2f524a4 already deleted. [ 859.837028] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.877986] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-434 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.878224] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-434" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.878306] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-434" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.878706] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-434" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.878871] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.879161] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.879356] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.879615] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.879795] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.880061] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 859.880209] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 859.880328] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 859.880441] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 859.880555] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 859.880685] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 859.880906] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 859.904887] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 859.904887] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 859.904887] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 859.904887] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-434" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.904887] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-53541f34-c055-44ae-adfe-c9d41e13fb77 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.904887] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-53541f34-c055-44ae-adfe-c9d41e13fb77" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.904887] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-53541f34-c055-44ae-adfe-c9d41e13fb77" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.904887] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-53541f34-c055-44ae-adfe-c9d41e13fb77" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.904887] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53541f34-c055-44ae-adfe-c9d41e13fb77',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.024287] env[62842]: INFO networking_nsxv3.common.synchronization [None req-49bb1cf4-9948-4e3e-aff3-e88f25ce5c27 None None] Enqueued Resource ID: f8bc2ed8-86f4-42e5-bec1-b238c7755001 with Priority: HIGHEST for action port [ 860.027099] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8bc2ed8-86f4-42e5-bec1-b238c7755001 with Priority: HIGHEST for action port [ 860.027099] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-f8bc2ed8-86f4-42e5-bec1-b238c7755001 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.027099] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f8bc2ed8-86f4-42e5-bec1-b238c7755001" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.027099] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f8bc2ed8-86f4-42e5-bec1-b238c7755001" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.027099] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f8bc2ed8-86f4-42e5-bec1-b238c7755001" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.027099] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8bc2ed8-86f4-42e5-bec1-b238c7755001',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.054368] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('437e64e0-ea9a-4d6f-88a7-838a0318993c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.407891] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.408115] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.408269] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.408553] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.408709] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.408871] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 53541f34-c055-44ae-adfe-c9d41e13fb77 not found, creating... [ 860.409164] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.409331] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.409452] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.409684] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.409830] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.410163] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.410330] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.410456] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.410665] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.410820] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.410953] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 53541f34-c055-44ae-adfe-c9d41e13fb77 is going to be created. [ 860.433154] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.433405] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.433531] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.433838] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.434028] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.434272] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-53541f34-c055-44ae-adfe-c9d41e13fb77" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.528727] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f8bc2ed8-86f4-42e5-bec1-b238c7755001 [ 860.528727] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.528727] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.528959] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.530213] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.530213] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.530213] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f8bc2ed8-86f4-42e5-bec1-b238c7755001 already deleted. [ 860.530213] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f8bc2ed8-86f4-42e5-bec1-b238c7755001" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.556513] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.556707] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.556761] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.557181] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.557181] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.557181] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 437e64e0-ea9a-4d6f-88a7-838a0318993c is going to be created. [ 860.595189] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.595331] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.595384] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.595592] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.595748] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.608447] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 437e64e0-ea9a-4d6f-88a7-838a0318993c in Status: UNINITIALIZED for 2s [ 860.997151] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83478649-c10f-45af-9cd9-d412883cd575 in Status: SUCCESS [ 860.997887] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83478649-c10f-45af-9cd9-d412883cd575" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.998114] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83478649-c10f-45af-9cd9-d412883cd575" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.998357] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83478649-c10f-45af-9cd9-d412883cd575" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.998574] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.998754] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.998796] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.998938] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.999033] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.999135] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83478649-c10f-45af-9cd9-d412883cd575" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.999237] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('83478649-c10f-45af-9cd9-d412883cd575',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.002235] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83478649-c10f-45af-9cd9-d412883cd575" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.002430] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83478649-c10f-45af-9cd9-d412883cd575" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.002625] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.002806] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.002843] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.003080] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.003080] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.003234] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83478649-c10f-45af-9cd9-d412883cd575',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.458317] env[62842]: INFO networking_nsxv3.common.synchronization [req-054ac95a-4f72-4895-a8b3-d291878b31a5 req-e71d02c3-e3bd-4e3a-8e97-8a8bd1393aa1 service nova] Enqueued Resource ID: 15e06d0a-ad75-4e9d-b1a6-db54b2f524a4 with Priority: HIGHEST for action security_group_rules [ 861.458584] env[62842]: INFO networking_nsxv3.common.synchronization [req-054ac95a-4f72-4895-a8b3-d291878b31a5 req-e71d02c3-e3bd-4e3a-8e97-8a8bd1393aa1 service nova] Enqueued Resource ID: 15e06d0a-ad75-4e9d-b1a6-db54b2f524a4 with Priority: HIGHEST for action security_group_members [ 861.459625] env[62842]: INFO networking_nsxv3.common.synchronization [req-054ac95a-4f72-4895-a8b3-d291878b31a5 req-e71d02c3-e3bd-4e3a-8e97-8a8bd1393aa1 service nova] Enqueued Resource ID: 53541f34-c055-44ae-adfe-c9d41e13fb77 with Priority: HIGHEST for action port [ 861.459625] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15e06d0a-ad75-4e9d-b1a6-db54b2f524a4 with Priority: HIGHEST for action security_group_rules [ 861.459625] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15e06d0a-ad75-4e9d-b1a6-db54b2f524a4 with Priority: HIGHEST for action security_group_members [ 861.459983] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53541f34-c055-44ae-adfe-c9d41e13fb77 with Priority: HIGHEST for action port [ 861.460332] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.460692] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.460692] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.460803] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.460887] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15e06d0a-ad75-4e9d-b1a6-db54b2f524a4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.463552] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.463552] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.463552] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.463552] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.463739] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.463739] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.463812] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.463932] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.464020] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.464111] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15e06d0a-ad75-4e9d-b1a6-db54b2f524a4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.464899] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-53541f34-c055-44ae-adfe-c9d41e13fb77 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.464995] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-53541f34-c055-44ae-adfe-c9d41e13fb77" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.465895] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-53541f34-c055-44ae-adfe-c9d41e13fb77" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.466200] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-53541f34-c055-44ae-adfe-c9d41e13fb77" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.466200] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53541f34-c055-44ae-adfe-c9d41e13fb77',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.502756] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('83478649-c10f-45af-9cd9-d412883cd575',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.506377] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('83478649-c10f-45af-9cd9-d412883cd575',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.968532] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 53541f34-c055-44ae-adfe-c9d41e13fb77 with status ACTIVE [ 861.968804] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.968942] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.969016] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.969270] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.969385] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.969573] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.969671] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.969734] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.969884] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.969958] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.970169] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.970276] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.970327] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.970456] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.970523] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.970885] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 53541f34-c055-44ae-adfe-c9d41e13fb77 is going to be updated. [ 861.971927] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15e06d0a-ad75-4e9d-b1a6-db54b2f524a4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.973401] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.973536] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.000913] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.001143] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.001255] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.001480] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.001615] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.001776] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-53541f34-c055-44ae-adfe-c9d41e13fb77" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.006326] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 83478649-c10f-45af-9cd9-d412883cd575: rpc.has_security_group_logging(os_id): False [ 862.010162] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('83478649-c10f-45af-9cd9-d412883cd575',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.034026] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.034026] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.034026] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.034026] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.034287] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.034321] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.034596] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.034596] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.034698] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.036017] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.036017] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 83478649-c10f-45af-9cd9-d412883cd575 is going to be updated. [ 862.114303] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.114303] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.114303] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.114303] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.114303] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.135297] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 83478649-c10f-45af-9cd9-d412883cd575 in Status: IN_PROGRESS for 2s [ 862.474696] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15e06d0a-ad75-4e9d-b1a6-db54b2f524a4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.512654] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.512654] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.512654] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.513061] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.513241] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.513441] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83478649-c10f-45af-9cd9-d412883cd575 is going to be updated. [ 862.553576] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.553576] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.553576] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.553576] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.553576] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.564839] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83478649-c10f-45af-9cd9-d412883cd575 in Status: IN_PROGRESS for 2s [ 862.618115] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 437e64e0-ea9a-4d6f-88a7-838a0318993c in Status: SUCCESS [ 862.618320] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-437e64e0-ea9a-4d6f-88a7-838a0318993c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.618537] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-437e64e0-ea9a-4d6f-88a7-838a0318993c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.618782] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-437e64e0-ea9a-4d6f-88a7-838a0318993c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.619073] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.619165] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.619258] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.619511] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.619511] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.620707] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-437e64e0-ea9a-4d6f-88a7-838a0318993c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.620707] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('437e64e0-ea9a-4d6f-88a7-838a0318993c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.978364] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.978552] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.978598] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.978803] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.978894] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.979100] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15e06d0a-ad75-4e9d-b1a6-db54b2f524a4 is going to be created. [ 863.013946] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.014171] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.014248] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.014498] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.014710] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.025814] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15e06d0a-ad75-4e9d-b1a6-db54b2f524a4 in Status: UNINITIALIZED for 2s [ 863.122726] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-437e64e0-ea9a-4d6f-88a7-838a0318993c taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.122726] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-437e64e0-ea9a-4d6f-88a7-838a0318993c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.122726] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-437e64e0-ea9a-4d6f-88a7-838a0318993c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.123072] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-437e64e0-ea9a-4d6f-88a7-838a0318993c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.123210] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.123344] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.123401] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.123724] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.123724] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.123849] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-437e64e0-ea9a-4d6f-88a7-838a0318993c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.124046] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-437e64e0-ea9a-4d6f-88a7-838a0318993c taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.124186] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-437e64e0-ea9a-4d6f-88a7-838a0318993c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.124263] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-437e64e0-ea9a-4d6f-88a7-838a0318993c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.124475] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-437e64e0-ea9a-4d6f-88a7-838a0318993c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.124625] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.124743] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.124816] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.125091] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.125150] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.125274] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-437e64e0-ea9a-4d6f-88a7-838a0318993c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.125429] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('437e64e0-ea9a-4d6f-88a7-838a0318993c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.628578] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 437e64e0-ea9a-4d6f-88a7-838a0318993c: rpc.has_security_group_logging(os_id): False [ 863.647558] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.647731] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.647872] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.648058] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.648163] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.648434] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.648519] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.648585] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.648831] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.648831] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.648999] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.649117] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.649179] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.649319] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.649391] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.649584] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.649683] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.649724] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.649855] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.649926] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.650123] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 437e64e0-ea9a-4d6f-88a7-838a0318993c is going to be created. [ 863.735038] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.735038] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.735038] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.735038] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.735038] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.748118] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 437e64e0-ea9a-4d6f-88a7-838a0318993c in Status: IN_PROGRESS for 2s [ 863.766732] env[62842]: INFO networking_nsxv3.common.synchronization [req-d13846e0-977d-461f-b8cf-ffada07d9f4e req-3f999537-e1e5-4828-b343-6a5ea354f2aa tempest-AttachInterfacesUnderV243Test-764117880 tempest-AttachInterfacesUnderV243Test-764117880-project-member] Enqueued Resource ID: 83478649-c10f-45af-9cd9-d412883cd575 with Priority: HIGHEST for action security_group_members [ 863.767448] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83478649-c10f-45af-9cd9-d412883cd575 with Priority: HIGHEST for action security_group_members [ 863.771351] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-83478649-c10f-45af-9cd9-d412883cd575 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.771456] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83478649-c10f-45af-9cd9-d412883cd575" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.151209] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 83478649-c10f-45af-9cd9-d412883cd575 in Status: SUCCESS [ 864.151688] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-83478649-c10f-45af-9cd9-d412883cd575" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.152841] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-83478649-c10f-45af-9cd9-d412883cd575" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.153961] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-83478649-c10f-45af-9cd9-d412883cd575" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.154266] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('83478649-c10f-45af-9cd9-d412883cd575',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.579146] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83478649-c10f-45af-9cd9-d412883cd575 in Status: SUCCESS [ 864.579146] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83478649-c10f-45af-9cd9-d412883cd575" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.579328] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83478649-c10f-45af-9cd9-d412883cd575" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.579540] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83478649-c10f-45af-9cd9-d412883cd575" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.579784] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.579925] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.579991] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.580282] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.580375] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.580615] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83478649-c10f-45af-9cd9-d412883cd575',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.592609] env[62842]: INFO networking_nsxv3.common.synchronization [req-9642b3bd-ca73-40f2-b90d-ff758c44fb76 req-f30abc0e-bc14-4ce2-acbe-c0b666f8be54 tempest-AttachVolumeNegativeTest-1420230652 tempest-AttachVolumeNegativeTest-1420230652-project-member] Enqueued Resource ID: 6588f3bb-b208-4ec7-8a50-1e573d683f24 with Priority: HIGHEST for action security_group_members [ 864.593237] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6588f3bb-b208-4ec7-8a50-1e573d683f24 with Priority: HIGHEST for action security_group_members [ 864.593575] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-6588f3bb-b208-4ec7-8a50-1e573d683f24 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.593694] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6588f3bb-b208-4ec7-8a50-1e573d683f24" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.593758] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6588f3bb-b208-4ec7-8a50-1e573d683f24" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.594044] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6588f3bb-b208-4ec7-8a50-1e573d683f24" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.594248] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.594359] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.594419] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.594577] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.594657] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.594747] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6588f3bb-b208-4ec7-8a50-1e573d683f24',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.681856] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.681856] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.681856] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.681856] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.681856] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.681856] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 83478649-c10f-45af-9cd9-d412883cd575 is going to be deleted. [ 864.735598] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.735783] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.735875] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.736040] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.736140] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.736267] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-83478649-c10f-45af-9cd9-d412883cd575" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.004425] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-468 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.004632] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-468" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.004757] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-468" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.005059] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-468" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.005352] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.005485] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.005604] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.006139] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.006303] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.006521] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 865.006637] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 865.006750] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 865.006880] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 865.007017] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 865.007134] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 865.007274] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 865.030092] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 865.030293] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 865.030447] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 865.030649] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-468" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.030964] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-e1e15451-4a41-4b12-ad0f-c4749c943698 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.034177] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-e1e15451-4a41-4b12-ad0f-c4749c943698" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.034177] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-e1e15451-4a41-4b12-ad0f-c4749c943698" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.034177] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-e1e15451-4a41-4b12-ad0f-c4749c943698" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.034177] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e1e15451-4a41-4b12-ad0f-c4749c943698',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.043182] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15e06d0a-ad75-4e9d-b1a6-db54b2f524a4 in Status: SUCCESS [ 865.043494] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.043594] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.043876] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.044088] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.044261] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.044311] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.044425] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.044507] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.044591] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.044683] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('15e06d0a-ad75-4e9d-b1a6-db54b2f524a4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.087295] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.087295] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.087295] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.087295] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.087295] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.087295] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.087295] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.087295] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.087295] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.087295] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.087295] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83478649-c10f-45af-9cd9-d412883cd575 is going to be deleted. [ 865.096920] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.099287] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.099287] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.099287] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.099287] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.099287] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.099287] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.099287] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.099287] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.099287] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.099287] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6588f3bb-b208-4ec7-8a50-1e573d683f24 already deleted. [ 865.099287] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6588f3bb-b208-4ec7-8a50-1e573d683f24" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.124458] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.124880] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.125095] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.125741] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.126360] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.126632] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83478649-c10f-45af-9cd9-d412883cd575" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.128993] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83478649-c10f-45af-9cd9-d412883cd575" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.128993] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83478649-c10f-45af-9cd9-d412883cd575" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.128993] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.128993] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.128993] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.128993] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.128993] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.128993] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83478649-c10f-45af-9cd9-d412883cd575',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.244567] env[62842]: INFO networking_nsxv3.common.synchronization [None req-7574f1b9-0936-49d4-b8df-6a2099820135 None None] Enqueued Resource ID: e651a783-1106-47c5-bdf4-9121d55178b4 with Priority: HIGHEST for action port [ 865.245327] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e651a783-1106-47c5-bdf4-9121d55178b4 with Priority: HIGHEST for action port [ 865.245753] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-e651a783-1106-47c5-bdf4-9121d55178b4 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.245937] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e651a783-1106-47c5-bdf4-9121d55178b4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.246946] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e651a783-1106-47c5-bdf4-9121d55178b4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.247267] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e651a783-1106-47c5-bdf4-9121d55178b4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.247393] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e651a783-1106-47c5-bdf4-9121d55178b4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.535841] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.535841] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.535841] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.535841] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.535841] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.535841] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port e1e15451-4a41-4b12-ad0f-c4749c943698 not found, creating... [ 865.536192] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.536243] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.536407] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.537334] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.537491] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.537789] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.537951] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.538294] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.538532] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.539077] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.539077] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: e1e15451-4a41-4b12-ad0f-c4749c943698 is going to be created. [ 865.548389] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('15e06d0a-ad75-4e9d-b1a6-db54b2f524a4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.561674] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.561674] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.561674] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.561674] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.561674] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.561674] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-e1e15451-4a41-4b12-ad0f-c4749c943698" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.630016] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.631536] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.631684] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.631916] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.632022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.632284] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.632708] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.632708] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.632708] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.632708] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.632708] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83478649-c10f-45af-9cd9-d412883cd575 already deleted. [ 865.633085] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83478649-c10f-45af-9cd9-d412883cd575" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.751937] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e651a783-1106-47c5-bdf4-9121d55178b4 [ 865.751937] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.751937] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.751937] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.751937] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.751937] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.751937] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e651a783-1106-47c5-bdf4-9121d55178b4 already deleted. [ 865.751937] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e651a783-1106-47c5-bdf4-9121d55178b4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.767762] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 437e64e0-ea9a-4d6f-88a7-838a0318993c in Status: SUCCESS [ 865.767762] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-437e64e0-ea9a-4d6f-88a7-838a0318993c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.050559] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 15e06d0a-ad75-4e9d-b1a6-db54b2f524a4: rpc.has_security_group_logging(os_id): False [ 866.069137] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.069306] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.069373] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.069617] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.069729] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.069979] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.070116] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.070243] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.070398] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.070484] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.070573] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15e06d0a-ad75-4e9d-b1a6-db54b2f524a4 is going to be created. [ 866.148095] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.148441] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.148441] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.148650] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.148860] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.162164] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15e06d0a-ad75-4e9d-b1a6-db54b2f524a4 in Status: IN_PROGRESS for 2s [ 866.475998] env[62842]: INFO networking_nsxv3.common.synchronization [req-9642b3bd-ca73-40f2-b90d-ff758c44fb76 req-6c9b21a5-46b6-437b-acce-f2566b01af69 service nova] Enqueued Resource ID: 6588f3bb-b208-4ec7-8a50-1e573d683f24 with Priority: HIGHEST for action security_group_rules [ 866.476217] env[62842]: INFO networking_nsxv3.common.synchronization [req-9642b3bd-ca73-40f2-b90d-ff758c44fb76 req-6c9b21a5-46b6-437b-acce-f2566b01af69 service nova] Enqueued Resource ID: 6588f3bb-b208-4ec7-8a50-1e573d683f24 with Priority: HIGHEST for action security_group_members [ 866.476359] env[62842]: INFO networking_nsxv3.common.synchronization [req-9642b3bd-ca73-40f2-b90d-ff758c44fb76 req-6c9b21a5-46b6-437b-acce-f2566b01af69 service nova] Enqueued Resource ID: e1e15451-4a41-4b12-ad0f-c4749c943698 with Priority: HIGHEST for action port [ 866.476596] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6588f3bb-b208-4ec7-8a50-1e573d683f24 with Priority: HIGHEST for action security_group_rules [ 866.476722] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6588f3bb-b208-4ec7-8a50-1e573d683f24 with Priority: HIGHEST for action security_group_members [ 866.476820] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1e15451-4a41-4b12-ad0f-c4749c943698 with Priority: HIGHEST for action port [ 866.477395] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6588f3bb-b208-4ec7-8a50-1e573d683f24 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.477522] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6588f3bb-b208-4ec7-8a50-1e573d683f24" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.477581] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6588f3bb-b208-4ec7-8a50-1e573d683f24" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.479385] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6588f3bb-b208-4ec7-8a50-1e573d683f24" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.479385] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6588f3bb-b208-4ec7-8a50-1e573d683f24',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.479385] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-6588f3bb-b208-4ec7-8a50-1e573d683f24 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.479385] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6588f3bb-b208-4ec7-8a50-1e573d683f24" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.479385] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6588f3bb-b208-4ec7-8a50-1e573d683f24" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.479385] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6588f3bb-b208-4ec7-8a50-1e573d683f24" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.479385] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.480563] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.480563] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.482176] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.482265] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.482369] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6588f3bb-b208-4ec7-8a50-1e573d683f24',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.483188] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-e1e15451-4a41-4b12-ad0f-c4749c943698 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.483302] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e1e15451-4a41-4b12-ad0f-c4749c943698" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.483372] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e1e15451-4a41-4b12-ad0f-c4749c943698" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.483532] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e1e15451-4a41-4b12-ad0f-c4749c943698" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.483647] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e1e15451-4a41-4b12-ad0f-c4749c943698',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.881973] env[62842]: INFO networking_nsxv3.common.synchronization [req-f2724870-ba58-404a-9686-2d5033758e53 req-b772c807-5b9a-4925-817f-dbbbfc614d44 tempest-ImagesOneServerNegativeTestJSON-864549307 tempest-ImagesOneServerNegativeTestJSON-864549307-project-member] Enqueued Resource ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd with Priority: HIGHEST for action security_group_members [ 866.882596] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd with Priority: HIGHEST for action security_group_members [ 866.882949] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.883117] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.883207] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.883434] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.883648] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.883774] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.883859] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.884046] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.884159] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.884294] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('82e532f4-b8b0-4a4a-affc-1ab5a63253cd',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.987837] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6588f3bb-b208-4ec7-8a50-1e573d683f24',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.987837] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-6588f3bb-b208-4ec7-8a50-1e573d683f24 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.987837] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6588f3bb-b208-4ec7-8a50-1e573d683f24" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.987837] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e1e15451-4a41-4b12-ad0f-c4749c943698 with status ACTIVE [ 866.987837] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.987837] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.987837] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.988308] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.988308] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.988308] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.988441] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.988478] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.988728] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.988728] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.988869] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.988958] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.989137] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.989240] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.990415] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.990415] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e1e15451-4a41-4b12-ad0f-c4749c943698 is going to be updated. [ 867.021639] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.021854] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.021854] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.022123] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.022378] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.022579] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e1e15451-4a41-4b12-ad0f-c4749c943698" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.369494] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-821 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.369695] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-821" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.369821] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-821" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.370108] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-821" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.372264] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.372264] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.372264] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.372264] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.372264] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.372264] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 867.372264] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 867.372264] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 867.372264] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 867.372264] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 867.372264] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 867.372264] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 867.387211] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.387342] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.387674] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.387883] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.387969] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.388313] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.388313] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.388417] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.388548] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.388604] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.388705] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd is going to be updated. [ 867.395251] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 867.395387] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 867.395610] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 867.395710] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-821" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.396193] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-4b951350-8178-4503-8b9a-c8993f1b3422 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.396397] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-4b951350-8178-4503-8b9a-c8993f1b3422" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.396915] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-4b951350-8178-4503-8b9a-c8993f1b3422" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.396984] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-4b951350-8178-4503-8b9a-c8993f1b3422" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.397425] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b951350-8178-4503-8b9a-c8993f1b3422',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.424351] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.424877] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.424984] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.425210] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.425433] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.436919] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd in Status: IN_PROGRESS for 2s [ 867.492510] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6588f3bb-b208-4ec7-8a50-1e573d683f24',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.896147] env[62842]: INFO networking_nsxv3.common.synchronization [req-14d2e29f-ebd9-4227-94cb-6234abc38b5f req-3477017f-d2b4-4a36-abca-718e062985bc tempest-AttachInterfacesTestJSON-2140085841 tempest-AttachInterfacesTestJSON-2140085841-project-member] Enqueued Resource ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 with Priority: HIGHEST for action security_group_members [ 867.896147] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 with Priority: HIGHEST for action security_group_members [ 867.896446] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.896523] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.896559] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.900019] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.900019] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.900019] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.900019] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.900019] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.900019] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.900019] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77637a7d-8eb8-4f0e-a5bd-9870e0d191c6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.900019] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.900019] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.900019] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.900019] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.900551] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.900551] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 4b951350-8178-4503-8b9a-c8993f1b3422 not found, creating... [ 867.900670] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.900756] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.900873] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.901096] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.901451] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.901759] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.901916] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.902047] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.902641] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.902812] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.902961] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 4b951350-8178-4503-8b9a-c8993f1b3422 is going to be created. [ 867.927295] env[62842]: INFO networking_nsxv3.common.synchronization [None req-8c247181-7b28-4824-b370-d2597b6226dd None None] Enqueued Resource ID: 92e5a8d9-7000-4e3c-b2d1-afb840b28459 with Priority: HIGHEST for action port [ 867.927638] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.927944] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.928099] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.928383] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.928613] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.928888] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-4b951350-8178-4503-8b9a-c8993f1b3422" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.933229] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92e5a8d9-7000-4e3c-b2d1-afb840b28459 with Priority: HIGHEST for action port [ 867.933229] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-92e5a8d9-7000-4e3c-b2d1-afb840b28459 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.933229] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92e5a8d9-7000-4e3c-b2d1-afb840b28459" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.933229] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92e5a8d9-7000-4e3c-b2d1-afb840b28459" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.933229] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92e5a8d9-7000-4e3c-b2d1-afb840b28459" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.933229] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92e5a8d9-7000-4e3c-b2d1-afb840b28459',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.007256] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.007898] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.007898] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.010094] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.010094] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.010094] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6588f3bb-b208-4ec7-8a50-1e573d683f24 is going to be created. [ 868.043982] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.044161] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.044206] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.044410] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.044567] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.056713] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6588f3bb-b208-4ec7-8a50-1e573d683f24 in Status: UNINITIALIZED for 2s [ 868.176597] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15e06d0a-ad75-4e9d-b1a6-db54b2f524a4 in Status: SUCCESS [ 868.176825] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.356649] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-416 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.357215] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-416" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.357328] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-416" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.358048] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-416" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.358453] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.358672] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.358846] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.359625] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.359802] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.360043] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 868.360163] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 868.360364] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 868.360491] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 868.360609] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 868.360728] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 868.360868] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 868.381497] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 868.381730] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 868.381877] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 868.382070] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-416" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.382424] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-d92f2407-b134-4672-8dcb-20416fea068b taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.382638] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-d92f2407-b134-4672-8dcb-20416fea068b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.382769] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-d92f2407-b134-4672-8dcb-20416fea068b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.387800] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-d92f2407-b134-4672-8dcb-20416fea068b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.388533] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d92f2407-b134-4672-8dcb-20416fea068b',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.405897] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.406071] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.406184] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.406350] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.406441] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.406999] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.406999] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.406999] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.406999] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.406999] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.407439] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 already deleted. [ 868.407439] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.435064] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 92e5a8d9-7000-4e3c-b2d1-afb840b28459 [ 868.435064] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.435064] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.435451] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.435451] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.435451] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.435579] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:92e5a8d9-7000-4e3c-b2d1-afb840b28459 already deleted. [ 868.435633] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92e5a8d9-7000-4e3c-b2d1-afb840b28459" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.890205] env[62842]: INFO networking_nsxv3.common.synchronization [req-f2724870-ba58-404a-9686-2d5033758e53 req-6622b90a-8fc2-4603-be50-a5254f2727ab service nova] Enqueued Resource ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd with Priority: HIGHEST for action security_group_rules [ 868.890503] env[62842]: INFO networking_nsxv3.common.synchronization [req-f2724870-ba58-404a-9686-2d5033758e53 req-6622b90a-8fc2-4603-be50-a5254f2727ab service nova] Enqueued Resource ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd with Priority: HIGHEST for action security_group_members [ 868.890609] env[62842]: INFO networking_nsxv3.common.synchronization [req-f2724870-ba58-404a-9686-2d5033758e53 req-6622b90a-8fc2-4603-be50-a5254f2727ab service nova] Enqueued Resource ID: 4b951350-8178-4503-8b9a-c8993f1b3422 with Priority: HIGHEST for action port [ 868.891145] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd with Priority: HIGHEST for action security_group_rules [ 868.891304] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd with Priority: HIGHEST for action security_group_members [ 868.891440] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b951350-8178-4503-8b9a-c8993f1b3422 with Priority: HIGHEST for action port [ 868.891730] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-82e532f4-b8b0-4a4a-affc-1ab5a63253cd taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.891842] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.891904] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.892522] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.892616] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('82e532f4-b8b0-4a4a-affc-1ab5a63253cd',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.893701] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.893701] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.893858] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b951350-8178-4503-8b9a-c8993f1b3422 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.893957] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b951350-8178-4503-8b9a-c8993f1b3422" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.894019] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b951350-8178-4503-8b9a-c8993f1b3422" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.894267] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b951350-8178-4503-8b9a-c8993f1b3422" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.894350] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b951350-8178-4503-8b9a-c8993f1b3422',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.895899] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.896095] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.896250] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.897269] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.897477] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.897647] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port d92f2407-b134-4672-8dcb-20416fea068b not found, creating... [ 868.897956] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.898223] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.898396] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.898740] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.898973] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.899417] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.899707] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.899885] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.902923] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.903031] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.903202] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: d92f2407-b134-4672-8dcb-20416fea068b is going to be created. [ 868.929574] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.929804] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.929952] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.930291] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.930566] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.930850] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-d92f2407-b134-4672-8dcb-20416fea068b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.396575] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.396711] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.405177] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4b951350-8178-4503-8b9a-c8993f1b3422 with status ACTIVE [ 869.405413] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.405553] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.405621] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.405840] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.405928] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.406122] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.406252] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.406323] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.406422] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.406508] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.406837] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.406837] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.406837] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.407101] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.407101] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.407101] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4b951350-8178-4503-8b9a-c8993f1b3422 is going to be updated. [ 869.432894] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.434561] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.434561] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.434561] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.434561] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.434561] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b951350-8178-4503-8b9a-c8993f1b3422" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.447297] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd in Status: SUCCESS [ 869.447493] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd deletion is rescheduled due to dependency. [ 869.447608] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.447940] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.448592] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.448592] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.448592] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.448592] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.448812] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.448812] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.448918] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('82e532f4-b8b0-4a4a-affc-1ab5a63253cd',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.737447] env[62842]: INFO networking_nsxv3.common.synchronization [req-14d2e29f-ebd9-4227-94cb-6234abc38b5f req-5c2d306e-5642-405a-9962-9f30827927b2 service nova] Enqueued Resource ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 with Priority: HIGHEST for action security_group_rules [ 869.737674] env[62842]: INFO networking_nsxv3.common.synchronization [req-14d2e29f-ebd9-4227-94cb-6234abc38b5f req-5c2d306e-5642-405a-9962-9f30827927b2 service nova] Enqueued Resource ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 with Priority: HIGHEST for action security_group_members [ 869.737821] env[62842]: INFO networking_nsxv3.common.synchronization [req-14d2e29f-ebd9-4227-94cb-6234abc38b5f req-5c2d306e-5642-405a-9962-9f30827927b2 service nova] Enqueued Resource ID: d92f2407-b134-4672-8dcb-20416fea068b with Priority: HIGHEST for action port [ 869.738838] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 with Priority: HIGHEST for action security_group_rules [ 869.739580] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 with Priority: HIGHEST for action security_group_members [ 869.739580] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d92f2407-b134-4672-8dcb-20416fea068b with Priority: HIGHEST for action port [ 869.739815] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.740195] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.740195] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.740917] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.740917] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('77637a7d-8eb8-4f0e-a5bd-9870e0d191c6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.741800] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.742099] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.744022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.744022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.744022] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.744022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.744022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.744022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.744022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.744022] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77637a7d-8eb8-4f0e-a5bd-9870e0d191c6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.744022] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-d92f2407-b134-4672-8dcb-20416fea068b taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.744022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d92f2407-b134-4672-8dcb-20416fea068b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.744847] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d92f2407-b134-4672-8dcb-20416fea068b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.744847] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d92f2407-b134-4672-8dcb-20416fea068b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.744847] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d92f2407-b134-4672-8dcb-20416fea068b',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.951365] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('82e532f4-b8b0-4a4a-affc-1ab5a63253cd',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.068860] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6588f3bb-b208-4ec7-8a50-1e573d683f24 in Status: SUCCESS [ 870.068860] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6588f3bb-b208-4ec7-8a50-1e573d683f24" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.068860] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6588f3bb-b208-4ec7-8a50-1e573d683f24" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.068860] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6588f3bb-b208-4ec7-8a50-1e573d683f24" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.068860] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.069070] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.069070] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.069819] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.069819] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.069819] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6588f3bb-b208-4ec7-8a50-1e573d683f24" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.069819] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6588f3bb-b208-4ec7-8a50-1e573d683f24',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.246943] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.247081] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.247275] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('77637a7d-8eb8-4f0e-a5bd-9870e0d191c6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.248581] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d92f2407-b134-4672-8dcb-20416fea068b with status ACTIVE [ 870.248768] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.248889] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.248976] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.249245] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.249731] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.249731] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.249731] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.249731] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.250391] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.250391] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.250391] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.250391] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.250391] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.250613] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.250613] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.250679] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d92f2407-b134-4672-8dcb-20416fea068b is going to be updated. [ 870.274033] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.274171] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.274209] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.274505] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.274742] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.275021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d92f2407-b134-4672-8dcb-20416fea068b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.453417] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('82e532f4-b8b0-4a4a-affc-1ab5a63253cd',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.572027] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6588f3bb-b208-4ec7-8a50-1e573d683f24',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.753436] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('77637a7d-8eb8-4f0e-a5bd-9870e0d191c6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.956046] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.956372] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.956372] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.956569] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.956692] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.956842] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd is going to be updated. [ 870.991919] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.992146] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.992248] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.992526] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.992703] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.004498] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd in Status: IN_PROGRESS for 2s [ 871.074524] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6588f3bb-b208-4ec7-8a50-1e573d683f24: rpc.has_security_group_logging(os_id): False [ 871.097170] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.097170] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.097170] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.097170] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.097170] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.097455] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.097520] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.097587] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.097771] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.097858] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.097961] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6588f3bb-b208-4ec7-8a50-1e573d683f24 is going to be created. [ 871.171624] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.171768] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.172139] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.172139] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.172323] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.186743] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6588f3bb-b208-4ec7-8a50-1e573d683f24 in Status: IN_PROGRESS for 2s [ 871.255603] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.255874] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.255874] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.256216] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.256296] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.256425] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 is going to be created. [ 871.296023] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.296312] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.296374] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.296610] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.296838] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.311604] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 in Status: UNINITIALIZED for 2s [ 873.017241] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd in Status: SUCCESS [ 873.017241] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.017790] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.017790] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.017790] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.017915] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.017915] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.018364] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.018364] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.018364] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.018505] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('82e532f4-b8b0-4a4a-affc-1ab5a63253cd',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.204053] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6588f3bb-b208-4ec7-8a50-1e573d683f24 in Status: SUCCESS [ 873.204439] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6588f3bb-b208-4ec7-8a50-1e573d683f24" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.324379] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 in Status: SUCCESS [ 873.324578] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.324741] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.324961] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.325476] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.325601] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.325665] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.325830] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.325907] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.325992] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.326094] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('77637a7d-8eb8-4f0e-a5bd-9870e0d191c6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.529502] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.529502] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.529502] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.529502] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.529502] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.529502] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.529502] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.529502] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.529502] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.529502] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.529502] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.529502] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.529502] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.530066] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.530066] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.530066] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.530066] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.530066] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.530220] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.530220] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.530293] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('82e532f4-b8b0-4a4a-affc-1ab5a63253cd',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.687167] env[62842]: INFO networking_nsxv3.common.synchronization [req-1ad876c3-f0a9-4cbb-8dd8-6128624fe3f4 req-50e1a239-29c0-4c48-8543-d4226f73f24a tempest-ServerDiskConfigTestJSON-797549774 tempest-ServerDiskConfigTestJSON-797549774-project-member] Enqueued Resource ID: c184a589-476a-49bd-9984-d339a77ec8f3 with Priority: HIGHEST for action security_group_members [ 873.687167] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c184a589-476a-49bd-9984-d339a77ec8f3 with Priority: HIGHEST for action security_group_members [ 873.687167] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-c184a589-476a-49bd-9984-d339a77ec8f3 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.687167] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.687167] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.687643] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.687950] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.688205] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.688374] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.688644] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.688882] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.689183] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c184a589-476a-49bd-9984-d339a77ec8f3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.831902] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.831902] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.831902] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.831902] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.831902] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.831902] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.831902] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.831902] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.831902] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.831902] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.831902] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.831902] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.831902] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.831902] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.831902] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.831902] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.832672] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.832672] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.832672] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.832672] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.832672] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('77637a7d-8eb8-4f0e-a5bd-9870e0d191c6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.033124] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 82e532f4-b8b0-4a4a-affc-1ab5a63253cd: rpc.has_security_group_logging(os_id): False [ 874.054312] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.054790] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.054790] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.054941] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.055109] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.055419] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.055530] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.055611] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.055863] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.055980] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.056318] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.056664] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.056741] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.056964] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.057102] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.057333] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.057472] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.057553] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.057724] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.057825] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.057934] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd is going to be updated. [ 874.136017] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.136288] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.136431] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.137346] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.137518] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.158750] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd in Status: IN_PROGRESS for 2s [ 874.194699] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.194699] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.194699] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.194699] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.194699] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.194699] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.194699] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.194699] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.194699] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.194699] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.194699] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c184a589-476a-49bd-9984-d339a77ec8f3 is going to be updated. [ 874.206151] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-51 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.206367] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-51" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.206629] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-51" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.206846] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-51" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.207036] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.207197] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.208304] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.208304] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.208304] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.208304] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 874.208304] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 874.208304] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 874.208751] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 874.208751] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 874.208751] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 874.208905] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 874.228653] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.228653] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.228653] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.228653] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.228828] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.237958] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 874.240827] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 874.240827] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 874.242388] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-51" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.245154] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-5e173f2e-b375-4f2e-bdf8-10149f025dfa taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.245154] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-5e173f2e-b375-4f2e-bdf8-10149f025dfa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.245805] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-5e173f2e-b375-4f2e-bdf8-10149f025dfa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.246058] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-5e173f2e-b375-4f2e-bdf8-10149f025dfa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.247823] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e173f2e-b375-4f2e-bdf8-10149f025dfa',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.257419] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c184a589-476a-49bd-9984-d339a77ec8f3 in Status: IN_PROGRESS for 2s [ 874.335947] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6: rpc.has_security_group_logging(os_id): False [ 874.357574] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.357574] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.357574] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.357797] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.357797] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.358688] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.358816] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.358876] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.359450] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.359450] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.359450] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.359656] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.359656] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.359791] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.359832] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.360028] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.360567] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.360567] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.360567] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.360567] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.360567] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 is going to be created. [ 874.438705] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.438937] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.438937] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.439102] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.439509] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.455926] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 in Status: IN_PROGRESS for 2s [ 874.755263] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.755540] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.755750] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.756348] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.756348] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.756470] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 5e173f2e-b375-4f2e-bdf8-10149f025dfa not found, creating... [ 874.756782] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.757126] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.757126] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.758415] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.758415] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.758415] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.758415] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.758415] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.758415] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.758415] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.758778] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 5e173f2e-b375-4f2e-bdf8-10149f025dfa is going to be created. [ 874.799335] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.799335] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.799335] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.799335] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.799335] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.799687] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-5e173f2e-b375-4f2e-bdf8-10149f025dfa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.693017] env[62842]: INFO networking_nsxv3.common.synchronization [req-1ad876c3-f0a9-4cbb-8dd8-6128624fe3f4 req-3ad26737-d2ce-4646-89aa-e4c2bbcc8ac1 service nova] Enqueued Resource ID: c184a589-476a-49bd-9984-d339a77ec8f3 with Priority: HIGHEST for action security_group_rules [ 875.693017] env[62842]: INFO networking_nsxv3.common.synchronization [req-1ad876c3-f0a9-4cbb-8dd8-6128624fe3f4 req-3ad26737-d2ce-4646-89aa-e4c2bbcc8ac1 service nova] Enqueued Resource ID: c184a589-476a-49bd-9984-d339a77ec8f3 with Priority: HIGHEST for action security_group_members [ 875.693017] env[62842]: INFO networking_nsxv3.common.synchronization [req-1ad876c3-f0a9-4cbb-8dd8-6128624fe3f4 req-3ad26737-d2ce-4646-89aa-e4c2bbcc8ac1 service nova] Enqueued Resource ID: 5e173f2e-b375-4f2e-bdf8-10149f025dfa with Priority: HIGHEST for action port [ 875.693534] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c184a589-476a-49bd-9984-d339a77ec8f3 with Priority: HIGHEST for action security_group_rules [ 875.693534] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c184a589-476a-49bd-9984-d339a77ec8f3 with Priority: HIGHEST for action security_group_members [ 875.693534] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e173f2e-b375-4f2e-bdf8-10149f025dfa with Priority: HIGHEST for action port [ 875.695038] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c184a589-476a-49bd-9984-d339a77ec8f3 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.695038] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.695038] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.695038] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.695038] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c184a589-476a-49bd-9984-d339a77ec8f3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.695464] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-c184a589-476a-49bd-9984-d339a77ec8f3 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.695464] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.695464] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e173f2e-b375-4f2e-bdf8-10149f025dfa taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.695653] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e173f2e-b375-4f2e-bdf8-10149f025dfa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.695653] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e173f2e-b375-4f2e-bdf8-10149f025dfa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.695761] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e173f2e-b375-4f2e-bdf8-10149f025dfa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.695826] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e173f2e-b375-4f2e-bdf8-10149f025dfa',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.176056] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd in Status: SUCCESS [ 876.176166] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.198691] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-c184a589-476a-49bd-9984-d339a77ec8f3 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.198838] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.199575] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5e173f2e-b375-4f2e-bdf8-10149f025dfa with status ACTIVE [ 876.199575] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.199575] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.199575] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.199575] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.199820] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.199820] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.200032] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.200032] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.200122] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.200205] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.200426] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.200533] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.200598] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.200843] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.200843] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.200947] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5e173f2e-b375-4f2e-bdf8-10149f025dfa is going to be updated. [ 876.223041] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.223041] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.223041] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.223349] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.223349] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.223508] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e173f2e-b375-4f2e-bdf8-10149f025dfa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.268828] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c184a589-476a-49bd-9984-d339a77ec8f3 in Status: SUCCESS [ 876.269055] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c184a589-476a-49bd-9984-d339a77ec8f3 deletion is rescheduled due to dependency. [ 876.269210] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.270019] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.270019] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.270019] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.270308] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.270308] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.270469] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.270585] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.270702] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c184a589-476a-49bd-9984-d339a77ec8f3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.468418] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 in Status: SUCCESS [ 876.468692] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.777872] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c184a589-476a-49bd-9984-d339a77ec8f3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.284032] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c184a589-476a-49bd-9984-d339a77ec8f3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.467271] env[62842]: INFO networking_nsxv3.common.synchronization [req-587fef68-f468-47ce-834e-4c7980cf66a6 req-3d80d2b8-f720-48c0-b8d6-b8f5c2339d43 tempest-InstanceActionsTestJSON-1995068943 tempest-InstanceActionsTestJSON-1995068943-project-member] Enqueued Resource ID: 437e64e0-ea9a-4d6f-88a7-838a0318993c with Priority: HIGHEST for action security_group_members [ 877.467271] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 437e64e0-ea9a-4d6f-88a7-838a0318993c with Priority: HIGHEST for action security_group_members [ 877.467271] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-437e64e0-ea9a-4d6f-88a7-838a0318993c taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.467271] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-437e64e0-ea9a-4d6f-88a7-838a0318993c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.467271] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-437e64e0-ea9a-4d6f-88a7-838a0318993c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.467271] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-437e64e0-ea9a-4d6f-88a7-838a0318993c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.467709] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.467709] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.467709] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.467709] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.467920] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.467920] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('437e64e0-ea9a-4d6f-88a7-838a0318993c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.785731] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.786080] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.786080] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.786333] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.786460] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.786782] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c184a589-476a-49bd-9984-d339a77ec8f3 is going to be updated. [ 877.821738] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.821900] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.821970] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.822542] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.822542] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.833106] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c184a589-476a-49bd-9984-d339a77ec8f3 in Status: IN_PROGRESS for 2s [ 877.972335] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.972335] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.972335] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.972335] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.972335] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.972335] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.972335] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.972335] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.972335] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.972335] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.972981] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 437e64e0-ea9a-4d6f-88a7-838a0318993c is going to be updated. [ 878.020089] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.020352] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.020414] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.020843] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.020843] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.033698] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 437e64e0-ea9a-4d6f-88a7-838a0318993c in Status: IN_PROGRESS for 2s [ 879.517023] env[62842]: INFO networking_nsxv3.common.synchronization [req-f4b0b0c3-0d52-484f-8cfd-331bc71765b6 req-d0e63074-fa70-4b2c-a6f6-09f8b0c4caea tempest-ServersAdminTestJSON-1475908229 tempest-ServersAdminTestJSON-1475908229-project-member] Enqueued Resource ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e with Priority: HIGHEST for action security_group_members [ 879.517023] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e with Priority: HIGHEST for action security_group_members [ 879.517023] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.517023] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.520906] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.520906] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.520906] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.520906] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.520906] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.520906] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.520906] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.520906] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7acb0f4-6157-4a0c-977e-ee6a2808aa0e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.866897] env[62842]: INFO networking_nsxv3.common.synchronization [req-5af39d7e-5e26-4d6d-ab43-5244c204c5d5 req-5dfbfcdd-63e4-43bf-ab53-51d45e5bdf1b tempest-ImagesOneServerNegativeTestJSON-864549307 tempest-ImagesOneServerNegativeTestJSON-864549307-project-member] Enqueued Resource ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd with Priority: HIGHEST for action security_group_members [ 879.867717] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd with Priority: HIGHEST for action security_group_members [ 879.871990] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.871990] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.871990] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.871990] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.872361] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.872361] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.872442] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.872673] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.872807] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.872984] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('82e532f4-b8b0-4a4a-affc-1ab5a63253cd',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.877119] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c184a589-476a-49bd-9984-d339a77ec8f3 in Status: SUCCESS [ 879.877453] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.878139] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.878437] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.878769] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.878873] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.879020] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.879350] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.879486] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.879634] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.879778] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c184a589-476a-49bd-9984-d339a77ec8f3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.934509] env[62842]: INFO networking_nsxv3.common.synchronization [req-42369c82-5d2f-40ad-ad1e-c0bdbcb40ad2 req-25614418-e396-4738-a959-bb4a366442ab tempest-ServersTestMultiNic-2049983028 tempest-ServersTestMultiNic-2049983028-project-member] Enqueued Resource ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 with Priority: HIGHEST for action security_group_members [ 879.935034] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 with Priority: HIGHEST for action security_group_members [ 879.935347] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e90c0f27-4513-40eb-ba31-bf40f699d9a6 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.935459] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.936034] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.936034] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.936034] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.936183] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.936183] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.936271] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.936352] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.936443] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e90c0f27-4513-40eb-ba31-bf40f699d9a6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.022783] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.023703] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.023703] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.023832] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.050072] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.050072] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.050072] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.050072] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.050072] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.050072] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.050072] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e is going to be updated. [ 880.050904] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 437e64e0-ea9a-4d6f-88a7-838a0318993c in Status: SUCCESS [ 880.051198] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 437e64e0-ea9a-4d6f-88a7-838a0318993c deletion is rescheduled due to dependency. [ 880.051465] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-437e64e0-ea9a-4d6f-88a7-838a0318993c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.078952] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.079151] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.079221] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.079405] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.079550] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.091690] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e in Status: IN_PROGRESS for 2s [ 880.309065] env[62842]: INFO networking_nsxv3.common.synchronization [req-42369c82-5d2f-40ad-ad1e-c0bdbcb40ad2 req-ae374da2-659c-4876-bcd7-74a24732f0ce tempest-ServersTestMultiNic-2049983028 tempest-ServersTestMultiNic-2049983028-project-member] Enqueued Resource ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 with Priority: HIGHEST for action security_group_members [ 880.309736] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 with Priority: HIGHEST for action security_group_members [ 880.310363] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e90c0f27-4513-40eb-ba31-bf40f699d9a6 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.310508] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.381785] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.382188] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.382188] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.382452] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.382548] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.382855] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.383065] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.383147] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.383402] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.383542] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.383702] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd is going to be updated. [ 880.385224] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-c184a589-476a-49bd-9984-d339a77ec8f3 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.385797] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.385938] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.386160] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.386390] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.386538] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.386631] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.386846] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.386961] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.387099] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.387313] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-c184a589-476a-49bd-9984-d339a77ec8f3 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.387449] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.388066] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.388066] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.388066] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.388066] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.388253] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.388355] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.388422] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.388537] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.388662] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c184a589-476a-49bd-9984-d339a77ec8f3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.429433] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.429637] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.429637] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.429850] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.429964] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.438319] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.438472] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.438542] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.438770] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.438860] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.439082] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.439184] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.439259] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.439386] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.439453] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.439541] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 already deleted. [ 880.439625] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.440178] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.440648] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.440648] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.440648] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.440832] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.440832] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.440898] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.441021] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e90c0f27-4513-40eb-ba31-bf40f699d9a6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.442556] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd in Status: IN_PROGRESS for 2s [ 880.666714] env[62842]: INFO networking_nsxv3.common.synchronization [req-42369c82-5d2f-40ad-ad1e-c0bdbcb40ad2 req-bc651a00-e531-4f71-a115-fc3d97583609 tempest-ServersTestMultiNic-2049983028 tempest-ServersTestMultiNic-2049983028-project-member] Enqueued Resource ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 with Priority: HIGHEST for action security_group_members [ 880.667268] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 with Priority: HIGHEST for action security_group_members [ 880.667575] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e90c0f27-4513-40eb-ba31-bf40f699d9a6 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.667679] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.893959] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c184a589-476a-49bd-9984-d339a77ec8f3: rpc.has_security_group_logging(os_id): False [ 880.912819] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.912962] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.913473] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.913473] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.913473] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.916173] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.916333] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.916466] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.916604] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.916695] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.916908] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.917031] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.917079] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.917226] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.917305] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.917485] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.917578] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.917640] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.917776] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.917851] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.917939] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c184a589-476a-49bd-9984-d339a77ec8f3 is going to be updated. [ 880.944694] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.944832] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.944907] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.945137] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.945230] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.945422] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.945589] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.945589] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.945717] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.945791] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.945873] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 already deleted. [ 880.945953] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.946506] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.946674] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.946826] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.946921] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.946983] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.947128] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.947198] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.947292] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e90c0f27-4513-40eb-ba31-bf40f699d9a6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.999021] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.999021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.999021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.999021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.999021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.010528] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c184a589-476a-49bd-9984-d339a77ec8f3 in Status: IN_PROGRESS for 2s [ 881.054653] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-267 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.054653] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-267" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.054653] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-267" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.058612] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-267" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.059457] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.059457] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.059457] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.059756] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.059979] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.060504] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 881.060723] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 881.060892] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 881.061075] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 881.061253] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 881.061434] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 881.061626] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 881.086317] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 881.086498] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 881.086709] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 881.086948] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-267" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.087394] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-42f8447c-00cd-4379-9763-3026d2a522d6 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.087585] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-42f8447c-00cd-4379-9763-3026d2a522d6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.087742] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-42f8447c-00cd-4379-9763-3026d2a522d6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.088140] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-42f8447c-00cd-4379-9763-3026d2a522d6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.088377] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42f8447c-00cd-4379-9763-3026d2a522d6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.451358] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.451358] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.451358] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.451634] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.451634] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.451791] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.451949] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.451949] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.452104] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.452179] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.452265] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 already deleted. [ 881.452344] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.591311] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.591571] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.591707] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.592014] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.592172] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.592334] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 42f8447c-00cd-4379-9763-3026d2a522d6 not found, creating... [ 881.592619] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.592783] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.592914] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.593153] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.593295] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.593591] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.593751] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.593937] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.594105] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.594250] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.594394] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 42f8447c-00cd-4379-9763-3026d2a522d6 is going to be created. [ 881.621610] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.621984] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.622216] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.622631] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.622976] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.623332] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-42f8447c-00cd-4379-9763-3026d2a522d6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.105039] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e in Status: SUCCESS [ 882.105039] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e deletion is rescheduled due to dependency. [ 882.105039] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.456375] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd in Status: SUCCESS [ 882.456704] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd deletion is rescheduled due to dependency. [ 882.456898] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.523565] env[62842]: INFO networking_nsxv3.common.synchronization [req-42369c82-5d2f-40ad-ad1e-c0bdbcb40ad2 req-32b5771e-af68-4f91-9869-f9926316b7bf service nova] Enqueued Resource ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 with Priority: HIGHEST for action security_group_rules [ 882.523805] env[62842]: INFO networking_nsxv3.common.synchronization [req-42369c82-5d2f-40ad-ad1e-c0bdbcb40ad2 req-32b5771e-af68-4f91-9869-f9926316b7bf service nova] Enqueued Resource ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 with Priority: HIGHEST for action security_group_members [ 882.524018] env[62842]: INFO networking_nsxv3.common.synchronization [req-42369c82-5d2f-40ad-ad1e-c0bdbcb40ad2 req-32b5771e-af68-4f91-9869-f9926316b7bf service nova] Enqueued Resource ID: 42f8447c-00cd-4379-9763-3026d2a522d6 with Priority: HIGHEST for action port [ 882.524614] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 with Priority: HIGHEST for action security_group_rules [ 882.524782] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 with Priority: HIGHEST for action security_group_members [ 882.524953] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42f8447c-00cd-4379-9763-3026d2a522d6 with Priority: HIGHEST for action port [ 882.526171] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e90c0f27-4513-40eb-ba31-bf40f699d9a6 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.526171] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.526316] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.526654] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.526800] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e90c0f27-4513-40eb-ba31-bf40f699d9a6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.527919] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e90c0f27-4513-40eb-ba31-bf40f699d9a6 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.528112] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.528240] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.528495] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.528762] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.528915] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.529023] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.529295] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.529459] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.529591] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e90c0f27-4513-40eb-ba31-bf40f699d9a6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.530635] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-42f8447c-00cd-4379-9763-3026d2a522d6 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.530635] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42f8447c-00cd-4379-9763-3026d2a522d6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.530865] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42f8447c-00cd-4379-9763-3026d2a522d6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.530985] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42f8447c-00cd-4379-9763-3026d2a522d6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.531163] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42f8447c-00cd-4379-9763-3026d2a522d6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.838101] env[62842]: INFO networking_nsxv3.common.synchronization [req-470b0909-f618-4b0d-891a-cf060a8e7fe9 req-2c341356-c93a-4295-a1d1-64481b9501d7 tempest-AttachInterfacesTestJSON-2140085841 tempest-AttachInterfacesTestJSON-2140085841-project-member] Enqueued Resource ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 with Priority: HIGHEST for action security_group_members [ 882.838869] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 with Priority: HIGHEST for action security_group_members [ 882.840161] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.840161] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.840161] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.840161] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.840161] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.840161] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.840161] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.840161] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.840161] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.840161] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77637a7d-8eb8-4f0e-a5bd-9870e0d191c6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.843197] env[62842]: INFO networking_nsxv3.common.synchronization [req-eb5dcd60-0bcf-49f7-ae97-b5d5d4a34d34 req-06c251f4-dc57-4db4-aa4d-863d233211f2 tempest-DeleteServersTestJSON-1113791748 tempest-DeleteServersTestJSON-1113791748-project-member] Enqueued Resource ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 with Priority: HIGHEST for action security_group_members [ 882.843549] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 with Priority: HIGHEST for action security_group_members [ 882.844289] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-35146777-fd28-4ac7-b454-f7dd3fbb5846 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.844289] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.844289] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.844576] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.844668] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.844805] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.844885] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.845064] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.845177] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.845285] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('35146777-fd28-4ac7-b454-f7dd3fbb5846',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.002817] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-241 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.004355] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-241" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.004578] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-241" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.005033] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-241" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.005470] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.005784] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.006265] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.006426] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.006776] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.007093] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 883.007273] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 883.007427] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 883.007573] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 883.007765] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 883.007953] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 883.008256] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 883.025205] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c184a589-476a-49bd-9984-d339a77ec8f3 in Status: SUCCESS [ 883.025443] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.031520] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 883.031749] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 883.031898] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 883.032098] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-241" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.032422] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-c36492d9-9b8d-426a-bb95-872ee88df3c1 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.032602] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-c36492d9-9b8d-426a-bb95-872ee88df3c1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.032723] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-c36492d9-9b8d-426a-bb95-872ee88df3c1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.033069] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-c36492d9-9b8d-426a-bb95-872ee88df3c1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.033236] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c36492d9-9b8d-426a-bb95-872ee88df3c1',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.034151] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e90c0f27-4513-40eb-ba31-bf40f699d9a6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.035342] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e90c0f27-4513-40eb-ba31-bf40f699d9a6 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.035342] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.035342] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 42f8447c-00cd-4379-9763-3026d2a522d6 with status ACTIVE [ 883.035557] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.035557] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.035557] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.035695] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.036317] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.036317] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.036317] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.036317] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.036317] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.036317] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.036556] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.036556] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.036680] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.036799] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.036852] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.036901] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 42f8447c-00cd-4379-9763-3026d2a522d6 is going to be updated. [ 883.064446] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.064592] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.064675] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.064878] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.065024] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.065191] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42f8447c-00cd-4379-9763-3026d2a522d6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.344343] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.344662] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.344750] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.345013] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.345169] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.345450] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.345602] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.345729] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.345994] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.346136] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.346250] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 is going to be updated. [ 883.348168] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.348332] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.348427] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.348665] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.348665] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.348874] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.349008] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.349106] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.349322] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.349471] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.349611] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 is going to be updated. [ 883.375807] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.376037] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.376037] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.376246] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.376393] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.378024] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.378642] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.378725] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.378890] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.379040] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.388795] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 in Status: IN_PROGRESS for 2s [ 883.389575] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 in Status: IN_PROGRESS for 2s [ 883.539344] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.539654] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.539724] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.540091] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.540259] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.540667] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port c36492d9-9b8d-426a-bb95-872ee88df3c1 not found, creating... [ 883.540965] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.541251] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.541396] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.541634] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.541972] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.542373] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.542674] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.542830] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.543157] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.543443] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.543724] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: c36492d9-9b8d-426a-bb95-872ee88df3c1 is going to be created. [ 883.545251] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e90c0f27-4513-40eb-ba31-bf40f699d9a6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.568489] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.568763] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.568763] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.569056] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.569294] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.569560] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-c36492d9-9b8d-426a-bb95-872ee88df3c1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.047565] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.047863] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.047863] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.048044] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.048120] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.048325] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 is going to be created. [ 884.076791] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.077049] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.077049] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.077345] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.077554] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.088817] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 in Status: UNINITIALIZED for 2s [ 884.724191] env[62842]: INFO networking_nsxv3.common.synchronization [req-42369c82-5d2f-40ad-ad1e-c0bdbcb40ad2 req-ce888f9f-abe3-4455-8eee-70d6844ba46a service nova] Enqueued Resource ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 with Priority: HIGHEST for action security_group_rules [ 884.724191] env[62842]: INFO networking_nsxv3.common.synchronization [req-42369c82-5d2f-40ad-ad1e-c0bdbcb40ad2 req-ce888f9f-abe3-4455-8eee-70d6844ba46a service nova] Enqueued Resource ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 with Priority: HIGHEST for action security_group_members [ 884.724501] env[62842]: INFO networking_nsxv3.common.synchronization [req-42369c82-5d2f-40ad-ad1e-c0bdbcb40ad2 req-ce888f9f-abe3-4455-8eee-70d6844ba46a service nova] Enqueued Resource ID: c36492d9-9b8d-426a-bb95-872ee88df3c1 with Priority: HIGHEST for action port [ 884.725181] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 with Priority: HIGHEST for action security_group_rules [ 884.725252] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 with Priority: HIGHEST for action security_group_members [ 884.726400] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c36492d9-9b8d-426a-bb95-872ee88df3c1 with Priority: HIGHEST for action port [ 884.726400] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e90c0f27-4513-40eb-ba31-bf40f699d9a6 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.726400] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.726400] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e90c0f27-4513-40eb-ba31-bf40f699d9a6 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.726400] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.726400] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-c36492d9-9b8d-426a-bb95-872ee88df3c1 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.726400] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c36492d9-9b8d-426a-bb95-872ee88df3c1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.726400] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c36492d9-9b8d-426a-bb95-872ee88df3c1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.727072] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c36492d9-9b8d-426a-bb95-872ee88df3c1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.727072] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c36492d9-9b8d-426a-bb95-872ee88df3c1',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.116987] env[62842]: INFO networking_nsxv3.common.synchronization [req-4a988cdb-f38a-4845-9b93-e4eedd853241 req-25d0132d-f9b9-4211-a2d4-12120bc82eb4 tempest-ServersAdminNegativeTestJSON-1401896846 tempest-ServersAdminNegativeTestJSON-1401896846-project-member] Enqueued Resource ID: b47c6fcc-dd2d-4dd3-979a-610c0739cfd0 with Priority: HIGHEST for action security_group_members [ 885.117536] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b47c6fcc-dd2d-4dd3-979a-610c0739cfd0 with Priority: HIGHEST for action security_group_members [ 885.117862] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.117984] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.118063] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.118339] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.118501] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.118601] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.118664] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.118806] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.118890] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.118984] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b47c6fcc-dd2d-4dd3-979a-610c0739cfd0',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.232236] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c36492d9-9b8d-426a-bb95-872ee88df3c1 with status ACTIVE [ 885.232236] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.232236] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.232236] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.232236] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.232423] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.232452] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.232557] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.232617] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.232764] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.232837] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.233030] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.233120] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.233178] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.233312] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.233382] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.233465] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c36492d9-9b8d-426a-bb95-872ee88df3c1 is going to be updated. [ 885.260645] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.260795] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.260865] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.261088] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.262067] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.262067] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c36492d9-9b8d-426a-bb95-872ee88df3c1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.401769] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 in Status: SUCCESS [ 885.402012] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 deletion is rescheduled due to dependency. [ 885.402162] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.403135] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 in Status: SUCCESS [ 885.403334] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 deletion is rescheduled due to dependency. [ 885.403433] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.624515] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.624668] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.624740] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.624960] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.625086] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.625262] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.625359] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.625419] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.625580] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.625660] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.625743] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b47c6fcc-dd2d-4dd3-979a-610c0739cfd0 already deleted. [ 885.625823] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.851156] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-938 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.851461] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-938" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.851461] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-938" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.851744] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-938" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.852256] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.852256] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.852369] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.852556] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.852998] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.852998] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 885.852998] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 885.853394] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 885.853549] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 885.853670] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 885.853785] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 885.853953] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 885.858218] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-267 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.858521] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-267" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.858699] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-267" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.859133] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-267" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.860059] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.860307] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.860511] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.861228] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.861228] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.861228] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 885.861356] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 885.861436] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 885.861913] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 885.861913] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 885.861913] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 885.862067] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 885.883679] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 885.886023] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 885.886023] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 885.886023] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-267" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.886023] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-f93d59c6-60f6-4421-92d1-fe3c42ca91d2 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.886023] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-f93d59c6-60f6-4421-92d1-fe3c42ca91d2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.886023] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-f93d59c6-60f6-4421-92d1-fe3c42ca91d2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.886023] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-f93d59c6-60f6-4421-92d1-fe3c42ca91d2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.886023] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f93d59c6-60f6-4421-92d1-fe3c42ca91d2',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.888476] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 885.888746] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 885.888992] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 885.889293] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-938" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.890601] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-14fef226-f773-4d5a-886c-b9352bf2a0e3 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.890601] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-14fef226-f773-4d5a-886c-b9352bf2a0e3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.890601] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-14fef226-f773-4d5a-886c-b9352bf2a0e3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.890601] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-14fef226-f773-4d5a-886c-b9352bf2a0e3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.890601] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14fef226-f773-4d5a-886c-b9352bf2a0e3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.905202] env[62842]: INFO networking_nsxv3.common.synchronization [req-40862ead-8e43-49a9-9c03-5cbe0bf07228 req-cb83d079-5870-48a8-8325-b6fc4e662ac6 tempest-AttachInterfacesTestJSON-2140085841 tempest-AttachInterfacesTestJSON-2140085841-project-member] Enqueued Resource ID: e509406e-18a0-4842-8350-5830bdc3ec79 with Priority: HIGHEST for action security_group_members [ 885.905202] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e509406e-18a0-4842-8350-5830bdc3ec79 with Priority: HIGHEST for action security_group_members [ 885.905202] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e509406e-18a0-4842-8350-5830bdc3ec79 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.905202] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e509406e-18a0-4842-8350-5830bdc3ec79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.905478] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e509406e-18a0-4842-8350-5830bdc3ec79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.905878] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e509406e-18a0-4842-8350-5830bdc3ec79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.906151] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.906369] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.906517] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.906926] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.907119] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.907296] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e509406e-18a0-4842-8350-5830bdc3ec79',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.102639] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 in Status: SUCCESS [ 886.102639] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.102639] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.102639] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.102639] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.102639] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.102639] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.102639] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.102639] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.102639] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.102639] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e90c0f27-4513-40eb-ba31-bf40f699d9a6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.104081] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.104081] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.104081] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.104081] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.104081] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.104364] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.104364] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.104364] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e90c0f27-4513-40eb-ba31-bf40f699d9a6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.392730] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.393084] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.393084] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.393398] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.393604] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.393781] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port f93d59c6-60f6-4421-92d1-fe3c42ca91d2 not found, creating... [ 886.394789] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.395111] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.395284] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.395550] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.395708] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.395961] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.396220] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.396350] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.396506] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.396663] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.396828] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: f93d59c6-60f6-4421-92d1-fe3c42ca91d2 is going to be created. [ 886.398951] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.399168] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.399339] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.400215] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.400460] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.401072] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 14fef226-f773-4d5a-886c-b9352bf2a0e3 not found, creating... [ 886.401072] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.401312] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.401377] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.401647] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.403067] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.403067] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.403067] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.403067] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.403067] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.403067] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.403067] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 14fef226-f773-4d5a-886c-b9352bf2a0e3 is going to be created. [ 886.410669] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.410994] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.410994] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.411213] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.411306] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.411519] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.411606] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.411669] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.411819] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.411909] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.412034] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e509406e-18a0-4842-8350-5830bdc3ec79 is going to be updated. [ 886.428244] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.428668] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.428806] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.429106] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.429343] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.429593] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-f93d59c6-60f6-4421-92d1-fe3c42ca91d2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.432054] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.432249] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.432376] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.432661] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.432913] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.433160] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-14fef226-f773-4d5a-886c-b9352bf2a0e3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.452174] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.452174] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.452174] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.452174] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.452473] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.461972] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e509406e-18a0-4842-8350-5830bdc3ec79 in Status: IN_PROGRESS for 2s [ 886.606944] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e90c0f27-4513-40eb-ba31-bf40f699d9a6 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.606944] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.606944] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e90c0f27-4513-40eb-ba31-bf40f699d9a6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.109629] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e90c0f27-4513-40eb-ba31-bf40f699d9a6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.452327] env[62842]: INFO networking_nsxv3.common.synchronization [req-42369c82-5d2f-40ad-ad1e-c0bdbcb40ad2 req-8f18ac3b-e659-4699-b7b3-00f1802988b6 service nova] Enqueued Resource ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 with Priority: HIGHEST for action security_group_rules [ 887.452327] env[62842]: INFO networking_nsxv3.common.synchronization [req-42369c82-5d2f-40ad-ad1e-c0bdbcb40ad2 req-8f18ac3b-e659-4699-b7b3-00f1802988b6 service nova] Enqueued Resource ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 with Priority: HIGHEST for action security_group_members [ 887.452327] env[62842]: INFO networking_nsxv3.common.synchronization [req-42369c82-5d2f-40ad-ad1e-c0bdbcb40ad2 req-8f18ac3b-e659-4699-b7b3-00f1802988b6 service nova] Enqueued Resource ID: f93d59c6-60f6-4421-92d1-fe3c42ca91d2 with Priority: HIGHEST for action port [ 887.453245] env[62842]: INFO networking_nsxv3.common.synchronization [req-4a988cdb-f38a-4845-9b93-e4eedd853241 req-03e03059-203b-4f41-8269-55f322f28c75 service nova] Enqueued Resource ID: b47c6fcc-dd2d-4dd3-979a-610c0739cfd0 with Priority: HIGHEST for action security_group_rules [ 887.453472] env[62842]: INFO networking_nsxv3.common.synchronization [req-4a988cdb-f38a-4845-9b93-e4eedd853241 req-03e03059-203b-4f41-8269-55f322f28c75 service nova] Enqueued Resource ID: b47c6fcc-dd2d-4dd3-979a-610c0739cfd0 with Priority: HIGHEST for action security_group_members [ 887.453643] env[62842]: INFO networking_nsxv3.common.synchronization [req-4a988cdb-f38a-4845-9b93-e4eedd853241 req-03e03059-203b-4f41-8269-55f322f28c75 service nova] Enqueued Resource ID: 14fef226-f773-4d5a-886c-b9352bf2a0e3 with Priority: HIGHEST for action port [ 887.455676] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 with Priority: HIGHEST for action security_group_rules [ 887.455676] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f93d59c6-60f6-4421-92d1-fe3c42ca91d2 with Priority: HIGHEST for action port [ 887.455676] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14fef226-f773-4d5a-886c-b9352bf2a0e3 with Priority: HIGHEST for action port [ 887.455676] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b47c6fcc-dd2d-4dd3-979a-610c0739cfd0 with Priority: HIGHEST for action security_group_members [ 887.455676] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 with Priority: HIGHEST for action security_group_members [ 887.455676] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b47c6fcc-dd2d-4dd3-979a-610c0739cfd0 with Priority: HIGHEST for action security_group_rules [ 887.455676] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e90c0f27-4513-40eb-ba31-bf40f699d9a6 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.455676] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.455676] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-f93d59c6-60f6-4421-92d1-fe3c42ca91d2 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.455676] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f93d59c6-60f6-4421-92d1-fe3c42ca91d2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.455676] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f93d59c6-60f6-4421-92d1-fe3c42ca91d2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.456045] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f93d59c6-60f6-4421-92d1-fe3c42ca91d2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.456045] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f93d59c6-60f6-4421-92d1-fe3c42ca91d2',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.456921] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-14fef226-f773-4d5a-886c-b9352bf2a0e3 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.457050] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14fef226-f773-4d5a-886c-b9352bf2a0e3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.457116] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14fef226-f773-4d5a-886c-b9352bf2a0e3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.457294] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14fef226-f773-4d5a-886c-b9352bf2a0e3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.457368] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14fef226-f773-4d5a-886c-b9352bf2a0e3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.458247] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.458394] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.458493] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.458628] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.458776] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.458870] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.458953] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.459081] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.459162] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.459257] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b47c6fcc-dd2d-4dd3-979a-610c0739cfd0',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.460108] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e90c0f27-4513-40eb-ba31-bf40f699d9a6 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.460215] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.460634] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.460731] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.460791] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.460993] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.461079] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b47c6fcc-dd2d-4dd3-979a-610c0739cfd0',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.612668] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.612834] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.612907] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.613352] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.613352] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.613352] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 is going to be updated. [ 887.647073] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.647073] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.647073] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.647073] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.647073] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.657125] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 in Status: IN_PROGRESS for 2s [ 887.964251] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 14fef226-f773-4d5a-886c-b9352bf2a0e3 with status ACTIVE [ 887.964494] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.964626] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.964694] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.964943] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.965048] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.965234] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.965337] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.965401] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.965552] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.965629] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.965811] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.965912] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.965964] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.966109] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.966272] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.966272] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 14fef226-f773-4d5a-886c-b9352bf2a0e3 is going to be updated. [ 887.969087] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b47c6fcc-dd2d-4dd3-979a-610c0739cfd0',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.970221] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f93d59c6-60f6-4421-92d1-fe3c42ca91d2 with status ACTIVE [ 887.970417] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.970552] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.973634] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.973879] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.973972] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.974288] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.974288] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.974389] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.974472] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.974548] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.974743] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.974879] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.974969] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.975338] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.975338] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.975338] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f93d59c6-60f6-4421-92d1-fe3c42ca91d2 is going to be updated. [ 887.977242] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.977353] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.004126] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.004346] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.004384] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.004643] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.004797] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.005176] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14fef226-f773-4d5a-886c-b9352bf2a0e3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.006457] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.006590] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.006636] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.006854] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.006984] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.007833] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f93d59c6-60f6-4421-92d1-fe3c42ca91d2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.474242] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e509406e-18a0-4842-8350-5830bdc3ec79 in Status: SUCCESS [ 888.474242] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e509406e-18a0-4842-8350-5830bdc3ec79 deletion is rescheduled due to dependency. [ 888.474242] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e509406e-18a0-4842-8350-5830bdc3ec79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.478033] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b47c6fcc-dd2d-4dd3-979a-610c0739cfd0',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.481660] env[62842]: INFO networking_nsxv3.common.synchronization [req-f54b93e5-a266-4e98-9551-1731b7255ee8 req-cad05b3d-3e99-426b-aa99-d4ba6c5f32ca tempest-ServersWithSpecificFlavorTestJSON-2019624802 tempest-ServersWithSpecificFlavorTestJSON-2019624802-project-member] Enqueued Resource ID: 16baecd6-bda3-40e1-98ef-4e238a3fc354 with Priority: HIGHEST for action security_group_members [ 888.481832] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16baecd6-bda3-40e1-98ef-4e238a3fc354 with Priority: HIGHEST for action security_group_members [ 888.483239] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-16baecd6-bda3-40e1-98ef-4e238a3fc354 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.483239] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16baecd6-bda3-40e1-98ef-4e238a3fc354" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.483239] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16baecd6-bda3-40e1-98ef-4e238a3fc354" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.483239] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16baecd6-bda3-40e1-98ef-4e238a3fc354" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.483239] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.483239] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.483239] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.483239] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.484616] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.484747] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16baecd6-bda3-40e1-98ef-4e238a3fc354',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.981141] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.981427] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.981536] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.981827] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.981969] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.982132] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b47c6fcc-dd2d-4dd3-979a-610c0739cfd0 is going to be created. [ 888.990690] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.990690] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.990690] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.990690] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.990690] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.990690] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.990690] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.990690] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.990690] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.990690] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.990690] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16baecd6-bda3-40e1-98ef-4e238a3fc354 is going to be updated. [ 889.018038] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.018263] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.018263] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.021784] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.021784] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.027028] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.027028] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.027028] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.027028] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.027028] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.035201] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16baecd6-bda3-40e1-98ef-4e238a3fc354 in Status: IN_PROGRESS for 2s [ 889.036168] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b47c6fcc-dd2d-4dd3-979a-610c0739cfd0 in Status: UNINITIALIZED for 2s [ 889.263166] env[62842]: INFO networking_nsxv3.common.synchronization [req-01e37b81-88f0-427a-bcc9-ef3df0a64402 req-0cf874bc-68c7-49ec-8105-d703b6aed4a0 tempest-FloatingIPsAssociationTestJSON-1346363058 tempest-FloatingIPsAssociationTestJSON-1346363058-project-member] Enqueued Resource ID: 47118de8-4ba9-49a6-bc4b-d030be1e7c79 with Priority: HIGHEST for action security_group_members [ 889.263776] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47118de8-4ba9-49a6-bc4b-d030be1e7c79 with Priority: HIGHEST for action security_group_members [ 889.264275] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-47118de8-4ba9-49a6-bc4b-d030be1e7c79 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.264414] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.264483] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.264749] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.264921] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.265864] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.265968] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.266846] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.266965] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.267471] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47118de8-4ba9-49a6-bc4b-d030be1e7c79',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.671031] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 in Status: SUCCESS [ 889.671031] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.671031] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.671031] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.671031] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.671031] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.671031] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.671031] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.671031] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.671031] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.671031] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e90c0f27-4513-40eb-ba31-bf40f699d9a6 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.671031] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.671031] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.671031] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.671031] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.672023] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.672245] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.672518] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.672801] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.673025] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.673246] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e90c0f27-4513-40eb-ba31-bf40f699d9a6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.676634] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.676634] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.676634] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.676634] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.676634] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.676634] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.676634] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.676634] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e90c0f27-4513-40eb-ba31-bf40f699d9a6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.770077] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.772799] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.772799] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.772799] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.772799] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.772799] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.772799] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.772799] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.772799] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.772799] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.772799] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47118de8-4ba9-49a6-bc4b-d030be1e7c79 already deleted. [ 889.772799] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.121287] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-631 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.121466] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-631" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.121466] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-631" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.121805] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-631" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.125333] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.125571] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.125706] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.126096] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.126339] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.126651] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 890.126825] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 890.127013] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 890.128047] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 890.128047] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 890.128047] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 890.128047] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 890.154140] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 890.154401] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 890.154468] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 890.155220] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-631" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.155220] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-99bed1a6-9056-4c69-8a91-c83d4a368bb7 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.155220] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-99bed1a6-9056-4c69-8a91-c83d4a368bb7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.155470] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-99bed1a6-9056-4c69-8a91-c83d4a368bb7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.156770] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-99bed1a6-9056-4c69-8a91-c83d4a368bb7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.156770] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99bed1a6-9056-4c69-8a91-c83d4a368bb7',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.176640] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e90c0f27-4513-40eb-ba31-bf40f699d9a6: rpc.has_security_group_logging(os_id): False [ 890.178263] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e90c0f27-4513-40eb-ba31-bf40f699d9a6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.197340] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.197340] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.197340] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.197582] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.197708] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.197940] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.198069] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.198153] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.198333] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.198430] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.199136] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.199136] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.199136] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.199136] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.199136] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.199466] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.199466] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.199466] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.199755] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.199866] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.199967] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 is going to be created. [ 890.253422] env[62842]: INFO networking_nsxv3.common.synchronization [req-c26dd66b-b395-4d51-8a01-2c8e8808fc65 req-5627968e-30eb-45e0-833a-a102fcf3efbb tempest-ServerActionsTestJSON-670456711 tempest-ServerActionsTestJSON-670456711-project-member] Enqueued Resource ID: 03708cfa-ea22-40d4-8c09-177242e076fa with Priority: HIGHEST for action security_group_members [ 890.253985] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03708cfa-ea22-40d4-8c09-177242e076fa with Priority: HIGHEST for action security_group_members [ 890.254417] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-03708cfa-ea22-40d4-8c09-177242e076fa taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.254524] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03708cfa-ea22-40d4-8c09-177242e076fa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.254524] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03708cfa-ea22-40d4-8c09-177242e076fa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.254698] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03708cfa-ea22-40d4-8c09-177242e076fa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.254856] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.254955] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.255433] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.255640] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.255737] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.255840] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('03708cfa-ea22-40d4-8c09-177242e076fa',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.275299] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.275537] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.275608] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.276573] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.276573] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.296415] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 in Status: IN_PROGRESS for 2s [ 890.658417] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.658702] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.658834] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.659143] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.659304] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.659468] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 99bed1a6-9056-4c69-8a91-c83d4a368bb7 not found, creating... [ 890.659783] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.659951] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.660085] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.660313] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.660692] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.661030] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.661200] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.661348] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.664542] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.664745] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.664905] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 99bed1a6-9056-4c69-8a91-c83d4a368bb7 is going to be created. [ 890.680659] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e90c0f27-4513-40eb-ba31-bf40f699d9a6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.687363] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.687611] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.687740] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.688065] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.688353] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.688581] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-99bed1a6-9056-4c69-8a91-c83d4a368bb7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.759691] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.759849] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.759932] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.760172] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.760272] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.760548] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.760649] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.760711] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.760867] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.760943] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.761041] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03708cfa-ea22-40d4-8c09-177242e076fa is going to be updated. [ 890.809275] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.809461] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.809461] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.809684] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.809828] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.818995] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03708cfa-ea22-40d4-8c09-177242e076fa in Status: IN_PROGRESS for 2s [ 891.046580] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b47c6fcc-dd2d-4dd3-979a-610c0739cfd0 in Status: SUCCESS [ 891.046861] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.047645] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16baecd6-bda3-40e1-98ef-4e238a3fc354 in Status: SUCCESS [ 891.049531] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16baecd6-bda3-40e1-98ef-4e238a3fc354 deletion is rescheduled due to dependency. [ 891.049645] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16baecd6-bda3-40e1-98ef-4e238a3fc354" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.049800] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.050022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.050264] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.050331] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.050403] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.050573] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.050656] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.050739] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.050830] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b47c6fcc-dd2d-4dd3-979a-610c0739cfd0',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.184267] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.184586] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.185539] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.185539] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.185539] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.185539] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 is going to be updated. [ 891.220249] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.220446] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.220524] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.220733] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.220876] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.231520] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 in Status: IN_PROGRESS for 2s [ 891.250789] env[62842]: INFO networking_nsxv3.common.synchronization [req-01e37b81-88f0-427a-bcc9-ef3df0a64402 req-aac262fa-026f-459c-b503-c327b60de74a service nova] Enqueued Resource ID: 47118de8-4ba9-49a6-bc4b-d030be1e7c79 with Priority: HIGHEST for action security_group_rules [ 891.251667] env[62842]: INFO networking_nsxv3.common.synchronization [req-01e37b81-88f0-427a-bcc9-ef3df0a64402 req-aac262fa-026f-459c-b503-c327b60de74a service nova] Enqueued Resource ID: 47118de8-4ba9-49a6-bc4b-d030be1e7c79 with Priority: HIGHEST for action security_group_members [ 891.252814] env[62842]: INFO networking_nsxv3.common.synchronization [req-01e37b81-88f0-427a-bcc9-ef3df0a64402 req-aac262fa-026f-459c-b503-c327b60de74a service nova] Enqueued Resource ID: 99bed1a6-9056-4c69-8a91-c83d4a368bb7 with Priority: HIGHEST for action port [ 891.252814] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47118de8-4ba9-49a6-bc4b-d030be1e7c79 with Priority: HIGHEST for action security_group_rules [ 891.252814] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47118de8-4ba9-49a6-bc4b-d030be1e7c79 with Priority: HIGHEST for action security_group_members [ 891.252814] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99bed1a6-9056-4c69-8a91-c83d4a368bb7 with Priority: HIGHEST for action port [ 891.255480] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47118de8-4ba9-49a6-bc4b-d030be1e7c79 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.255621] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.255690] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.255970] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.256090] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47118de8-4ba9-49a6-bc4b-d030be1e7c79',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.256964] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-47118de8-4ba9-49a6-bc4b-d030be1e7c79 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.257089] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.257168] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.257340] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.257486] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.257580] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.257641] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.257778] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.257860] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.257953] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47118de8-4ba9-49a6-bc4b-d030be1e7c79',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.258719] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-99bed1a6-9056-4c69-8a91-c83d4a368bb7 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.258822] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-99bed1a6-9056-4c69-8a91-c83d4a368bb7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.258882] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-99bed1a6-9056-4c69-8a91-c83d4a368bb7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.260788] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-99bed1a6-9056-4c69-8a91-c83d4a368bb7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.260788] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99bed1a6-9056-4c69-8a91-c83d4a368bb7',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.554031] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.554184] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.554229] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.554429] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.554598] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.554859] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.554859] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.554960] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.554995] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.555081] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.555228] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.555351] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.555414] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.555626] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.555774] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.555869] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.555930] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.556084] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.556160] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.556241] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.556378] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b47c6fcc-dd2d-4dd3-979a-610c0739cfd0',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.762661] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('47118de8-4ba9-49a6-bc4b-d030be1e7c79',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.763882] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-47118de8-4ba9-49a6-bc4b-d030be1e7c79 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.764055] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.764531] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 99bed1a6-9056-4c69-8a91-c83d4a368bb7 with status ACTIVE [ 891.764927] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.765140] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.765211] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.769021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.769021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.769021] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.769021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.769021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.769021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.769021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.771037] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.771296] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.771417] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.771713] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.771861] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.772054] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 99bed1a6-9056-4c69-8a91-c83d4a368bb7 is going to be updated. [ 891.805128] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.805389] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.805454] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.809302] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.809302] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.809302] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-99bed1a6-9056-4c69-8a91-c83d4a368bb7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.059586] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b47c6fcc-dd2d-4dd3-979a-610c0739cfd0: rpc.has_security_group_logging(os_id): False [ 892.082548] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.083142] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.083317] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.083697] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.083856] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.084200] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.084536] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.084663] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.084883] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.085254] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.085649] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.085950] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.086161] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.086649] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.087056] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.087493] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.087752] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.087861] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.088092] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.088177] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.088285] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b47c6fcc-dd2d-4dd3-979a-610c0739cfd0 is going to be created. [ 892.159716] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.159879] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.159951] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.160181] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.160424] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.179028] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b47c6fcc-dd2d-4dd3-979a-610c0739cfd0 in Status: IN_PROGRESS for 2s [ 892.268037] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('47118de8-4ba9-49a6-bc4b-d030be1e7c79',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.312103] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 in Status: SUCCESS [ 892.312545] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.313538] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.313932] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.314233] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e90c0f27-4513-40eb-ba31-bf40f699d9a6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.770151] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.770531] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.770531] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.772548] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.772548] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.772548] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47118de8-4ba9-49a6-bc4b-d030be1e7c79 is going to be created. [ 892.812899] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.812899] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.812899] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.812899] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.812899] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.819466] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e90c0f27-4513-40eb-ba31-bf40f699d9a6 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.820841] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.835411] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47118de8-4ba9-49a6-bc4b-d030be1e7c79 in Status: UNINITIALIZED for 2s [ 892.836827] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03708cfa-ea22-40d4-8c09-177242e076fa in Status: SUCCESS [ 892.836827] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03708cfa-ea22-40d4-8c09-177242e076fa deletion is rescheduled due to dependency. [ 892.836827] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03708cfa-ea22-40d4-8c09-177242e076fa" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.244163] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 in Status: SUCCESS [ 893.244910] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.244910] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.245291] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.245291] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.246312] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.246312] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.246312] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.246312] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.246312] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.246312] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e90c0f27-4513-40eb-ba31-bf40f699d9a6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.664187] env[62842]: INFO networking_nsxv3.common.synchronization [None req-7d3d159f-5613-49a9-83c2-308071df078f None None] Enqueued Resource ID: 9ab04c2d-49f2-45f6-b387-51a35cc6bc1b with Priority: HIGHEST for action port [ 893.665153] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ab04c2d-49f2-45f6-b387-51a35cc6bc1b with Priority: HIGHEST for action port [ 893.665664] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ab04c2d-49f2-45f6-b387-51a35cc6bc1b taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.665889] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ab04c2d-49f2-45f6-b387-51a35cc6bc1b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.665987] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ab04c2d-49f2-45f6-b387-51a35cc6bc1b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.666357] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ab04c2d-49f2-45f6-b387-51a35cc6bc1b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.666484] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ab04c2d-49f2-45f6-b387-51a35cc6bc1b',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.748830] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e90c0f27-4513-40eb-ba31-bf40f699d9a6 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.749285] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.749463] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.749891] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.750205] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.750430] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.750491] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.750838] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.750970] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.751134] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.751424] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e90c0f27-4513-40eb-ba31-bf40f699d9a6 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.751528] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.751604] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.751844] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.752083] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.752289] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.752367] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.755519] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.755519] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.755519] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.755519] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e90c0f27-4513-40eb-ba31-bf40f699d9a6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.172544] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9ab04c2d-49f2-45f6-b387-51a35cc6bc1b [ 894.173042] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.173042] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.173225] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.173587] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.173587] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.173742] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9ab04c2d-49f2-45f6-b387-51a35cc6bc1b already deleted. [ 894.173742] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ab04c2d-49f2-45f6-b387-51a35cc6bc1b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.195696] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b47c6fcc-dd2d-4dd3-979a-610c0739cfd0 in Status: SUCCESS [ 894.195696] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.256124] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e90c0f27-4513-40eb-ba31-bf40f699d9a6: rpc.has_security_group_logging(os_id): False [ 894.280211] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.280211] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.280211] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.280211] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.280211] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.280211] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.280211] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.280211] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.280211] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.280211] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.280211] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.280211] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.280211] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.280211] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.280211] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.280777] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.280777] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.280777] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.280777] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.280777] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.280777] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 is going to be updated. [ 894.349660] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.349915] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.350076] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.350538] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.350722] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.368615] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 in Status: IN_PROGRESS for 2s [ 894.847197] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47118de8-4ba9-49a6-bc4b-d030be1e7c79 in Status: SUCCESS [ 894.847300] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.847988] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.848250] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.848584] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.848668] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.848714] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.848871] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.848951] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.849237] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.849353] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('47118de8-4ba9-49a6-bc4b-d030be1e7c79',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.911229] env[62842]: INFO networking_nsxv3.common.synchronization [None req-7462389c-15fb-4824-b0fe-b86f15d23794 tempest-ServersV294TestFqdnHostnames-685604315 tempest-ServersV294TestFqdnHostnames-685604315-project-member] Enqueued Resource ID: bc98288b-6b97-448c-a5b8-54058cb0d341 with Priority: HIGHEST for action security_group_rules [ 894.915645] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc98288b-6b97-448c-a5b8-54058cb0d341 with Priority: HIGHEST for action security_group_rules [ 894.917073] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc98288b-6b97-448c-a5b8-54058cb0d341 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.917202] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc98288b-6b97-448c-a5b8-54058cb0d341" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.917263] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc98288b-6b97-448c-a5b8-54058cb0d341" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.917557] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc98288b-6b97-448c-a5b8-54058cb0d341" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.917641] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc98288b-6b97-448c-a5b8-54058cb0d341',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.150986] env[62842]: INFO networking_nsxv3.common.synchronization [None req-e30511a7-c261-48fe-8692-4ab0e8c7c68b tempest-ServersV294TestFqdnHostnames-685604315 tempest-ServersV294TestFqdnHostnames-685604315-project-member] Enqueued Resource ID: bc98288b-6b97-448c-a5b8-54058cb0d341 with Priority: HIGHEST for action security_group_rules [ 895.154498] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc98288b-6b97-448c-a5b8-54058cb0d341 with Priority: HIGHEST for action security_group_rules [ 895.154498] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc98288b-6b97-448c-a5b8-54058cb0d341 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.154498] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc98288b-6b97-448c-a5b8-54058cb0d341" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.355505] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-47118de8-4ba9-49a6-bc4b-d030be1e7c79 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.355884] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.355884] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.355959] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.356125] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.356224] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.356286] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.356431] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.356518] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.356603] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.356746] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-47118de8-4ba9-49a6-bc4b-d030be1e7c79 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.356837] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.356896] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.357042] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.357181] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.357283] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.357341] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.357482] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.357555] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.357635] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.357735] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('47118de8-4ba9-49a6-bc4b-d030be1e7c79',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.444496] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.445665] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.445992] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.446466] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.446768] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.447048] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc98288b-6b97-448c-a5b8-54058cb0d341 already deleted. [ 895.447561] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc98288b-6b97-448c-a5b8-54058cb0d341" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.448811] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc98288b-6b97-448c-a5b8-54058cb0d341" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.449147] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc98288b-6b97-448c-a5b8-54058cb0d341" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.449356] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc98288b-6b97-448c-a5b8-54058cb0d341',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.861090] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 47118de8-4ba9-49a6-bc4b-d030be1e7c79: rpc.has_security_group_logging(os_id): False [ 895.880252] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.880252] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.880467] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.880625] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.880718] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.880909] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.881018] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.881083] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.881362] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.881362] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.881583] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.881689] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.881752] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.881894] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.882280] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.882370] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.882509] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.882605] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.882782] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.882901] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.883033] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47118de8-4ba9-49a6-bc4b-d030be1e7c79 is going to be created. [ 895.946393] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.946545] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.946601] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.946809] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.947069] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.962793] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47118de8-4ba9-49a6-bc4b-d030be1e7c79 in Status: IN_PROGRESS for 2s [ 896.006016] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.006448] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.006448] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.006448] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.006902] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.006902] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc98288b-6b97-448c-a5b8-54058cb0d341 already deleted. [ 896.006902] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc98288b-6b97-448c-a5b8-54058cb0d341" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.380970] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 in Status: SUCCESS [ 896.381346] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.381385] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.381640] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.381725] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e90c0f27-4513-40eb-ba31-bf40f699d9a6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.888128] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e90c0f27-4513-40eb-ba31-bf40f699d9a6 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.888128] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.888128] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.888128] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.888540] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.888540] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.888540] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.888540] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.888773] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.888773] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.888773] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e90c0f27-4513-40eb-ba31-bf40f699d9a6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.143243] env[62842]: INFO networking_nsxv3.common.synchronization [None req-a03d2462-fc5e-4e64-8425-31175f23ba2d None None] Enqueued Resource ID: faf3d760-dff2-45d8-a5b3-87db94676b9e with Priority: HIGHEST for action port [ 897.144116] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: faf3d760-dff2-45d8-a5b3-87db94676b9e with Priority: HIGHEST for action port [ 897.144116] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-faf3d760-dff2-45d8-a5b3-87db94676b9e taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.144116] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-faf3d760-dff2-45d8-a5b3-87db94676b9e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.144361] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-faf3d760-dff2-45d8-a5b3-87db94676b9e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.146233] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-faf3d760-dff2-45d8-a5b3-87db94676b9e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.146233] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('faf3d760-dff2-45d8-a5b3-87db94676b9e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.393520] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e90c0f27-4513-40eb-ba31-bf40f699d9a6 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.393520] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.393520] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.393520] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.393520] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.393520] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.393520] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.393520] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.394050] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.394050] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.394050] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e90c0f27-4513-40eb-ba31-bf40f699d9a6 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.394050] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.394050] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.394282] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.398260] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.398260] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.398260] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.398260] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.398260] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.398260] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.398260] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e90c0f27-4513-40eb-ba31-bf40f699d9a6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.650255] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port faf3d760-dff2-45d8-a5b3-87db94676b9e [ 897.650255] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.650446] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.650562] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.650927] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.652975] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.652975] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:faf3d760-dff2-45d8-a5b3-87db94676b9e already deleted. [ 897.652975] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-faf3d760-dff2-45d8-a5b3-87db94676b9e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.756660] env[62842]: INFO networking_nsxv3.common.synchronization [req-d655763a-6896-42dc-853e-96127f1334dc req-b574ac7e-b608-44af-b52f-e0061253e066 tempest-DeleteServersTestJSON-1113791748 tempest-DeleteServersTestJSON-1113791748-project-member] Enqueued Resource ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 with Priority: HIGHEST for action security_group_members [ 897.758266] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 with Priority: HIGHEST for action security_group_members [ 897.758679] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-35146777-fd28-4ac7-b454-f7dd3fbb5846 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.758810] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.758878] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.759389] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.759547] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.759674] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.759740] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.760638] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.760767] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.760884] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('35146777-fd28-4ac7-b454-f7dd3fbb5846',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.898024] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e90c0f27-4513-40eb-ba31-bf40f699d9a6: rpc.has_security_group_logging(os_id): False [ 897.919533] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.919730] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.919730] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.920085] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.920085] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.920236] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.920335] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.920601] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.920601] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.920697] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.920863] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.920957] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.921031] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.921174] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.921246] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.921438] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.921534] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.921573] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.921692] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.921765] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.921938] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 is going to be updated. [ 897.948705] env[62842]: INFO networking_nsxv3.common.synchronization [None req-44e58723-076b-4aa9-b261-ce009a7867ff None None] Enqueued Resource ID: ec113ea4-2367-4c88-a39f-9947244cd667 with Priority: HIGHEST for action port [ 897.949114] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec113ea4-2367-4c88-a39f-9947244cd667 with Priority: HIGHEST for action port [ 897.949580] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec113ea4-2367-4c88-a39f-9947244cd667 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.949689] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec113ea4-2367-4c88-a39f-9947244cd667" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.949757] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec113ea4-2367-4c88-a39f-9947244cd667" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.950015] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec113ea4-2367-4c88-a39f-9947244cd667" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.954936] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec113ea4-2367-4c88-a39f-9947244cd667',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.974579] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47118de8-4ba9-49a6-bc4b-d030be1e7c79 in Status: SUCCESS [ 897.974799] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.989260] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.989443] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.989488] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.989668] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.989847] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.005382] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 in Status: IN_PROGRESS for 2s [ 898.263451] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.263637] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.263700] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.263878] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.264111] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.264186] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.264270] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.264343] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.264478] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.264550] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.264637] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 is going to be updated. [ 898.294332] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.294481] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.294542] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.295573] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.295573] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.308534] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 in Status: IN_PROGRESS for 2s [ 898.449026] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-681 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.449026] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-681" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.449026] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-681" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.449026] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-681" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.449026] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.449026] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.449026] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.450282] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.453515] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.453515] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 898.453515] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 898.453515] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 898.453515] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 898.453515] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 898.453515] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 898.453515] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 898.460188] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ec113ea4-2367-4c88-a39f-9947244cd667 [ 898.460188] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.460188] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.460188] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.460188] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.460188] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.460188] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ec113ea4-2367-4c88-a39f-9947244cd667 already deleted. [ 898.460188] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec113ea4-2367-4c88-a39f-9947244cd667" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.470742] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 898.470944] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 898.471084] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 898.471382] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-681" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.471648] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-000db4e4-41c3-4f46-a1a9-9d5b9c17eb2f taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.471832] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-000db4e4-41c3-4f46-a1a9-9d5b9c17eb2f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.472042] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-000db4e4-41c3-4f46-a1a9-9d5b9c17eb2f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.472308] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-000db4e4-41c3-4f46-a1a9-9d5b9c17eb2f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.472461] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('000db4e4-41c3-4f46-a1a9-9d5b9c17eb2f',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.976892] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.977028] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.977131] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.977398] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.978459] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.978459] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 000db4e4-41c3-4f46-a1a9-9d5b9c17eb2f not found, creating... [ 898.978459] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.978459] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.978459] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.978740] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.978915] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.981295] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.981937] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.981937] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.981937] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.982619] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.982619] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 000db4e4-41c3-4f46-a1a9-9d5b9c17eb2f is going to be created. [ 899.008229] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.009474] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.009650] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.009911] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.010312] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.010654] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-000db4e4-41c3-4f46-a1a9-9d5b9c17eb2f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.026251] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 in Status: SUCCESS [ 900.026251] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.153278] env[62842]: INFO networking_nsxv3.common.synchronization [req-d655763a-6896-42dc-853e-96127f1334dc req-1df2d784-ee2f-40fd-99ce-62ff9b4143d3 service nova] Enqueued Resource ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 with Priority: HIGHEST for action security_group_rules [ 900.153278] env[62842]: INFO networking_nsxv3.common.synchronization [req-d655763a-6896-42dc-853e-96127f1334dc req-1df2d784-ee2f-40fd-99ce-62ff9b4143d3 service nova] Enqueued Resource ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 with Priority: HIGHEST for action security_group_members [ 900.153278] env[62842]: INFO networking_nsxv3.common.synchronization [req-d655763a-6896-42dc-853e-96127f1334dc req-1df2d784-ee2f-40fd-99ce-62ff9b4143d3 service nova] Enqueued Resource ID: 000db4e4-41c3-4f46-a1a9-9d5b9c17eb2f with Priority: HIGHEST for action port [ 900.153278] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 with Priority: HIGHEST for action security_group_rules [ 900.153278] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 with Priority: HIGHEST for action security_group_members [ 900.153278] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 000db4e4-41c3-4f46-a1a9-9d5b9c17eb2f with Priority: HIGHEST for action port [ 900.153278] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-35146777-fd28-4ac7-b454-f7dd3fbb5846 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.153278] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.153278] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.159018] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.159018] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('35146777-fd28-4ac7-b454-f7dd3fbb5846',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.159018] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-35146777-fd28-4ac7-b454-f7dd3fbb5846 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.159018] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.159018] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-000db4e4-41c3-4f46-a1a9-9d5b9c17eb2f taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.159018] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-000db4e4-41c3-4f46-a1a9-9d5b9c17eb2f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.159018] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-000db4e4-41c3-4f46-a1a9-9d5b9c17eb2f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.159018] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-000db4e4-41c3-4f46-a1a9-9d5b9c17eb2f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.159018] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('000db4e4-41c3-4f46-a1a9-9d5b9c17eb2f',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.328629] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 in Status: SUCCESS [ 900.328629] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 deletion is rescheduled due to dependency. [ 900.328629] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.328629] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.328629] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.328629] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.328867] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.328867] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.329415] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.329415] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.329415] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('35146777-fd28-4ac7-b454-f7dd3fbb5846',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.336020] env[62842]: INFO networking_nsxv3.common.synchronization [None req-109c745a-0762-4744-9100-c19fcc53658a None None] Enqueued Resource ID: 34eb412c-01fc-46d8-ad33-a460efa44d83 with Priority: HIGHEST for action port [ 900.338327] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34eb412c-01fc-46d8-ad33-a460efa44d83 with Priority: HIGHEST for action port [ 900.341418] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-34eb412c-01fc-46d8-ad33-a460efa44d83 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.341418] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-34eb412c-01fc-46d8-ad33-a460efa44d83" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.341418] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-34eb412c-01fc-46d8-ad33-a460efa44d83" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.341418] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-34eb412c-01fc-46d8-ad33-a460efa44d83" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.341418] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34eb412c-01fc-46d8-ad33-a460efa44d83',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.659952] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-35146777-fd28-4ac7-b454-f7dd3fbb5846 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.660295] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.661633] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 000db4e4-41c3-4f46-a1a9-9d5b9c17eb2f with status ACTIVE [ 900.661837] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.662143] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.662143] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.662383] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.662515] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.662760] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.662976] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.662976] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.663197] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.663310] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.663568] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.663700] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.663844] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.663973] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.664092] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.664209] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 000db4e4-41c3-4f46-a1a9-9d5b9c17eb2f is going to be updated. [ 900.689411] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.690203] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.690691] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.691164] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.691440] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.691795] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-000db4e4-41c3-4f46-a1a9-9d5b9c17eb2f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.740215] env[62842]: INFO networking_nsxv3.common.synchronization [req-ed037d9f-66ef-4afe-b1af-c2717af8b3c0 req-97b1053e-fe88-43a9-bf88-2792a467783c tempest-ServerDiskConfigTestJSON-797549774 tempest-ServerDiskConfigTestJSON-797549774-project-member] Enqueued Resource ID: c184a589-476a-49bd-9984-d339a77ec8f3 with Priority: HIGHEST for action security_group_members [ 900.740215] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c184a589-476a-49bd-9984-d339a77ec8f3 with Priority: HIGHEST for action security_group_members [ 900.740215] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-c184a589-476a-49bd-9984-d339a77ec8f3 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.740215] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.740215] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.740215] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.740215] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.741610] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.742271] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.743669] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.745501] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.745501] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c184a589-476a-49bd-9984-d339a77ec8f3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.838764] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('35146777-fd28-4ac7-b454-f7dd3fbb5846',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.844426] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 34eb412c-01fc-46d8-ad33-a460efa44d83 [ 900.844744] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.844936] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.845023] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.845286] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.845390] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.845493] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:34eb412c-01fc-46d8-ad33-a460efa44d83 already deleted. [ 900.845599] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-34eb412c-01fc-46d8-ad33-a460efa44d83" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.981796] env[62842]: INFO networking_nsxv3.common.synchronization [None req-e917bd8b-649a-4dcc-9f35-4693571d86ad tempest-AttachInterfacesTestJSON-2140085841 tempest-AttachInterfacesTestJSON-2140085841-project-member] Enqueued Resource ID: ae20759e-0e4f-4e29-8897-7eb813e03b32 with Priority: HIGHEST for action security_group_rules [ 900.982628] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae20759e-0e4f-4e29-8897-7eb813e03b32 with Priority: HIGHEST for action security_group_rules [ 900.984045] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae20759e-0e4f-4e29-8897-7eb813e03b32 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.984045] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae20759e-0e4f-4e29-8897-7eb813e03b32" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.984045] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae20759e-0e4f-4e29-8897-7eb813e03b32" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.984045] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae20759e-0e4f-4e29-8897-7eb813e03b32" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.987145] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae20759e-0e4f-4e29-8897-7eb813e03b32',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.185302] env[62842]: INFO networking_nsxv3.common.synchronization [None req-1b57afb0-dd35-44f8-9893-199cbbedfc8c tempest-AttachInterfacesTestJSON-2140085841 tempest-AttachInterfacesTestJSON-2140085841-project-member] Enqueued Resource ID: ae20759e-0e4f-4e29-8897-7eb813e03b32 with Priority: HIGHEST for action security_group_rules [ 901.186941] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae20759e-0e4f-4e29-8897-7eb813e03b32 with Priority: HIGHEST for action security_group_rules [ 901.186941] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae20759e-0e4f-4e29-8897-7eb813e03b32 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.186941] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae20759e-0e4f-4e29-8897-7eb813e03b32" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.248618] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.248618] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.248618] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.248618] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.248618] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.248618] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.248618] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.248618] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.248618] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.248618] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.248618] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c184a589-476a-49bd-9984-d339a77ec8f3 is going to be updated. [ 901.288113] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.288260] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.288449] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.288516] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.288652] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.300090] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c184a589-476a-49bd-9984-d339a77ec8f3 in Status: IN_PROGRESS for 2s [ 901.342424] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('35146777-fd28-4ac7-b454-f7dd3fbb5846',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.510094] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.510094] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.510094] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.510697] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.510697] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.510697] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae20759e-0e4f-4e29-8897-7eb813e03b32 already deleted. [ 901.510697] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae20759e-0e4f-4e29-8897-7eb813e03b32" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.510954] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae20759e-0e4f-4e29-8897-7eb813e03b32" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.510954] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae20759e-0e4f-4e29-8897-7eb813e03b32" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.511091] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae20759e-0e4f-4e29-8897-7eb813e03b32',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.730746] env[62842]: INFO networking_nsxv3.common.synchronization [req-810d41f5-24f3-4e0c-aa7c-145595a25e7b req-da46106a-0eb9-4d23-a2c5-1b9cc1126662 tempest-ServersTestMultiNic-2049983028 tempest-ServersTestMultiNic-2049983028-project-member] Enqueued Resource ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 with Priority: HIGHEST for action security_group_members [ 901.730746] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 with Priority: HIGHEST for action security_group_members [ 901.732147] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e90c0f27-4513-40eb-ba31-bf40f699d9a6 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.732320] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.733282] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.733282] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.733282] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.733282] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.733282] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.733282] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.733282] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.733618] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e90c0f27-4513-40eb-ba31-bf40f699d9a6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.848132] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.848132] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.848132] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.848132] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.848132] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.848132] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 is going to be updated. [ 901.876742] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.877179] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.877179] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.877436] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.877642] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.889264] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 in Status: IN_PROGRESS for 2s [ 901.993156] env[62842]: INFO networking_nsxv3.common.synchronization [req-810d41f5-24f3-4e0c-aa7c-145595a25e7b req-345c46af-8082-40d0-969f-35c4e9e5f0de tempest-ServersTestMultiNic-2049983028 tempest-ServersTestMultiNic-2049983028-project-member] Enqueued Resource ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 with Priority: HIGHEST for action security_group_members [ 901.993156] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 with Priority: HIGHEST for action security_group_members [ 901.993156] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e90c0f27-4513-40eb-ba31-bf40f699d9a6 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.993156] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.036198] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.036198] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.036198] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.036198] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.036198] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.036198] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae20759e-0e4f-4e29-8897-7eb813e03b32 already deleted. [ 902.036198] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae20759e-0e4f-4e29-8897-7eb813e03b32" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.237622] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e90c0f27-4513-40eb-ba31-bf40f699d9a6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.251067] env[62842]: INFO networking_nsxv3.common.synchronization [req-810d41f5-24f3-4e0c-aa7c-145595a25e7b req-563ceede-feb5-4a24-9473-ecdd92287b1b tempest-ServersTestMultiNic-2049983028 tempest-ServersTestMultiNic-2049983028-project-member] Enqueued Resource ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 with Priority: HIGHEST for action security_group_members [ 902.251067] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 with Priority: HIGHEST for action security_group_members [ 902.251836] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e90c0f27-4513-40eb-ba31-bf40f699d9a6 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.252483] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.740688] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e90c0f27-4513-40eb-ba31-bf40f699d9a6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.247544] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.247544] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.247544] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.247544] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.247544] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.247544] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 is going to be updated. [ 903.276823] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.278428] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.278619] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.281151] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.281735] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.297463] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 in Status: IN_PROGRESS for 2s [ 903.310254] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c184a589-476a-49bd-9984-d339a77ec8f3 in Status: SUCCESS [ 903.310363] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c184a589-476a-49bd-9984-d339a77ec8f3 deletion is rescheduled due to dependency. [ 903.310548] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.777204] env[62842]: INFO networking_nsxv3.common.synchronization [None req-fb4f67c3-d8f7-4397-a5fe-4fb4b1cd90e2 None None] Enqueued Resource ID: ab52d664-dbb7-4cec-804e-ad3fdbabd402 with Priority: HIGHEST for action port [ 903.777204] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab52d664-dbb7-4cec-804e-ad3fdbabd402 with Priority: HIGHEST for action port [ 903.778085] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab52d664-dbb7-4cec-804e-ad3fdbabd402 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.778085] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab52d664-dbb7-4cec-804e-ad3fdbabd402" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.778085] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab52d664-dbb7-4cec-804e-ad3fdbabd402" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.778085] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab52d664-dbb7-4cec-804e-ad3fdbabd402" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.778085] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab52d664-dbb7-4cec-804e-ad3fdbabd402',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.899468] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 in Status: SUCCESS [ 903.899468] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.899468] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.899468] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.899468] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.899468] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.899468] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.899468] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.899468] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.899468] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.899468] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('35146777-fd28-4ac7-b454-f7dd3fbb5846',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.142021] env[62842]: INFO networking_nsxv3.common.synchronization [None req-eb54c4c6-c052-432a-8476-65de1ca49ad0 None None] Enqueued Resource ID: 6f925e74-e796-42e0-aac6-adf9f75b339b with Priority: HIGHEST for action port [ 904.142021] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f925e74-e796-42e0-aac6-adf9f75b339b with Priority: HIGHEST for action port [ 904.142021] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-6f925e74-e796-42e0-aac6-adf9f75b339b taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.142021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6f925e74-e796-42e0-aac6-adf9f75b339b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.142021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6f925e74-e796-42e0-aac6-adf9f75b339b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.142021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6f925e74-e796-42e0-aac6-adf9f75b339b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.142021] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6f925e74-e796-42e0-aac6-adf9f75b339b',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.279968] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ab52d664-dbb7-4cec-804e-ad3fdbabd402 [ 904.281100] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.281100] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.281100] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.281100] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.281100] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.281407] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ab52d664-dbb7-4cec-804e-ad3fdbabd402 already deleted. [ 904.281407] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab52d664-dbb7-4cec-804e-ad3fdbabd402" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.402877] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-35146777-fd28-4ac7-b454-f7dd3fbb5846 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.403066] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.403119] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.403311] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.403547] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.403624] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.403624] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.403770] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.403859] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.403949] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.404110] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-35146777-fd28-4ac7-b454-f7dd3fbb5846 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.404204] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.404721] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.404721] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.404721] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.404721] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.404721] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.404932] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.404932] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.404932] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.405036] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('35146777-fd28-4ac7-b454-f7dd3fbb5846',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.644380] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6f925e74-e796-42e0-aac6-adf9f75b339b [ 904.644380] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.644380] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.644380] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.644380] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.644380] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.644380] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6f925e74-e796-42e0-aac6-adf9f75b339b already deleted. [ 904.644380] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6f925e74-e796-42e0-aac6-adf9f75b339b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.907443] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 35146777-fd28-4ac7-b454-f7dd3fbb5846: rpc.has_security_group_logging(os_id): False [ 904.927182] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.927412] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.927485] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.927708] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.927802] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.928016] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.928122] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.928199] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.928331] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.928748] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.928748] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.928952] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.928952] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.928952] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.929205] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.929438] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.929530] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.929589] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.929751] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.929815] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.929906] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 is going to be updated. [ 904.978270] env[62842]: INFO networking_nsxv3.common.synchronization [req-99c0d655-9bc1-457b-a348-5dbd212813a2 req-5df432c3-ff18-449c-9965-5376f51b199c tempest-SecurityGroupRulesTestJSON-1776752636 tempest-SecurityGroupRulesTestJSON-1776752636-project-member] Enqueued Resource ID: 2926b3d2-b0a9-4f72-8169-2845318a88ed with Priority: HIGHEST for action security_group_rules [ 904.979878] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2926b3d2-b0a9-4f72-8169-2845318a88ed with Priority: HIGHEST for action security_group_rules [ 904.979878] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2926b3d2-b0a9-4f72-8169-2845318a88ed taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.979878] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2926b3d2-b0a9-4f72-8169-2845318a88ed" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.979878] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2926b3d2-b0a9-4f72-8169-2845318a88ed" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.979878] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2926b3d2-b0a9-4f72-8169-2845318a88ed" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.979878] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2926b3d2-b0a9-4f72-8169-2845318a88ed',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.009045] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.010161] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.010161] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.010161] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.010161] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.025897] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 in Status: IN_PROGRESS for 2s [ 905.314717] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 in Status: SUCCESS [ 905.314717] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.315418] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.316777] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.316777] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.316777] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.316777] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.316965] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.317123] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.317300] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e90c0f27-4513-40eb-ba31-bf40f699d9a6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.504241] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.504422] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.504526] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.505104] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.505104] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.505104] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2926b3d2-b0a9-4f72-8169-2845318a88ed already deleted. [ 905.505104] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2926b3d2-b0a9-4f72-8169-2845318a88ed" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.794029] env[62842]: INFO networking_nsxv3.common.synchronization [req-016081f3-ed19-42d7-93ff-de13ae45f40a req-ea8d90c8-1af4-46c7-8144-494b8ca722f6 tempest-SecurityGroupRulesTestJSON-1776752636 tempest-SecurityGroupRulesTestJSON-1776752636-project-member] Enqueued Resource ID: 5e9d9700-0932-4585-a87c-f40709b4c983 with Priority: HIGHEST for action security_group_rules [ 905.794029] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e9d9700-0932-4585-a87c-f40709b4c983 with Priority: HIGHEST for action security_group_rules [ 905.794029] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e9d9700-0932-4585-a87c-f40709b4c983 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.794029] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e9d9700-0932-4585-a87c-f40709b4c983" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.794029] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e9d9700-0932-4585-a87c-f40709b4c983" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.794029] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e9d9700-0932-4585-a87c-f40709b4c983" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.794029] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e9d9700-0932-4585-a87c-f40709b4c983',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.824056] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.824056] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.824056] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.824056] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.824056] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.824056] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.824056] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.824056] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.824056] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.824056] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.824056] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 is going to be updated. [ 905.856184] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.856392] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.856392] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.856606] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.856746] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.867721] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 in Status: IN_PROGRESS for 2s [ 906.317323] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.317872] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.318064] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.318848] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.318848] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.318848] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e9d9700-0932-4585-a87c-f40709b4c983 already deleted. [ 906.318848] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e9d9700-0932-4585-a87c-f40709b4c983" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.521634] env[62842]: INFO networking_nsxv3.common.synchronization [None req-67903c4e-2c0b-461c-a1df-7980109fb47d None None] Enqueued Resource ID: 85bfbfb4-201a-4eca-98c8-23c4075dbe27 with Priority: HIGHEST for action port [ 906.522458] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85bfbfb4-201a-4eca-98c8-23c4075dbe27 with Priority: HIGHEST for action port [ 906.523272] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-85bfbfb4-201a-4eca-98c8-23c4075dbe27 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.523563] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-85bfbfb4-201a-4eca-98c8-23c4075dbe27" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.523771] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-85bfbfb4-201a-4eca-98c8-23c4075dbe27" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.525929] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-85bfbfb4-201a-4eca-98c8-23c4075dbe27" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.525929] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85bfbfb4-201a-4eca-98c8-23c4075dbe27',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.654987] env[62842]: INFO networking_nsxv3.common.synchronization [req-4c979ef2-1c6b-4e47-a4f8-81f48eb37bb0 req-aea0059f-452e-4699-92ea-657f97ade756 tempest-SecurityGroupRulesTestJSON-1776752636 tempest-SecurityGroupRulesTestJSON-1776752636-project-member] Enqueued Resource ID: 370b39fc-a8de-42dd-8972-5f4fd2b4b6c2 with Priority: HIGHEST for action security_group_rules [ 906.655707] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 370b39fc-a8de-42dd-8972-5f4fd2b4b6c2 with Priority: HIGHEST for action security_group_rules [ 906.657743] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-370b39fc-a8de-42dd-8972-5f4fd2b4b6c2 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.657743] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-370b39fc-a8de-42dd-8972-5f4fd2b4b6c2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.657743] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-370b39fc-a8de-42dd-8972-5f4fd2b4b6c2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.657743] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-370b39fc-a8de-42dd-8972-5f4fd2b4b6c2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.657743] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('370b39fc-a8de-42dd-8972-5f4fd2b4b6c2',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.965730] env[62842]: INFO networking_nsxv3.common.synchronization [None req-c73e743f-1cb6-4f52-88a8-bec5f278c061 None None] Enqueued Resource ID: 2ffb79ef-eeb5-48a2-8155-feedba5eb153 with Priority: HIGHEST for action port [ 906.970397] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ffb79ef-eeb5-48a2-8155-feedba5eb153 with Priority: HIGHEST for action port [ 906.971696] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ffb79ef-eeb5-48a2-8155-feedba5eb153 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.971696] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ffb79ef-eeb5-48a2-8155-feedba5eb153" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.971696] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ffb79ef-eeb5-48a2-8155-feedba5eb153" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.971696] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ffb79ef-eeb5-48a2-8155-feedba5eb153" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.971696] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ffb79ef-eeb5-48a2-8155-feedba5eb153',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.026930] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 85bfbfb4-201a-4eca-98c8-23c4075dbe27 [ 907.027221] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.027292] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.027355] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.027564] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.027656] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.027754] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:85bfbfb4-201a-4eca-98c8-23c4075dbe27 already deleted. [ 907.027837] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-85bfbfb4-201a-4eca-98c8-23c4075dbe27" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.045066] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 in Status: SUCCESS [ 907.045303] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.183155] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.183395] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.183520] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.183842] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.184014] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.184225] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 370b39fc-a8de-42dd-8972-5f4fd2b4b6c2 already deleted. [ 907.184389] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-370b39fc-a8de-42dd-8972-5f4fd2b4b6c2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.474725] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2ffb79ef-eeb5-48a2-8155-feedba5eb153 [ 907.475093] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.475093] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.475206] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.475357] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.475447] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.475540] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2ffb79ef-eeb5-48a2-8155-feedba5eb153 already deleted. [ 907.475622] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ffb79ef-eeb5-48a2-8155-feedba5eb153" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.488092] env[62842]: INFO networking_nsxv3.common.synchronization [req-2a685ecb-71ed-45f2-b6ac-aacbfaa3d571 req-0c68cf90-1123-4110-bec2-39e1f198979e tempest-SecurityGroupRulesTestJSON-1776752636 tempest-SecurityGroupRulesTestJSON-1776752636-project-member] Enqueued Resource ID: d8f09afb-feb2-4daf-94fc-fd2a5be18745 with Priority: HIGHEST for action security_group_rules [ 907.488452] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8f09afb-feb2-4daf-94fc-fd2a5be18745 with Priority: HIGHEST for action security_group_rules [ 907.488792] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8f09afb-feb2-4daf-94fc-fd2a5be18745 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.488932] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8f09afb-feb2-4daf-94fc-fd2a5be18745" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.488996] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8f09afb-feb2-4daf-94fc-fd2a5be18745" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.489257] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8f09afb-feb2-4daf-94fc-fd2a5be18745" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.489340] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8f09afb-feb2-4daf-94fc-fd2a5be18745',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.594728] env[62842]: INFO networking_nsxv3.common.synchronization [req-b7d4027c-b481-495c-ad8c-5c13d38fe657 req-e54182e4-d483-477b-9987-072269dac23f tempest-ServersV294TestFqdnHostnames-685604315 tempest-ServersV294TestFqdnHostnames-685604315-project-member] Enqueued Resource ID: bc98288b-6b97-448c-a5b8-54058cb0d341 with Priority: HIGHEST for action security_group_members [ 907.594728] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc98288b-6b97-448c-a5b8-54058cb0d341 with Priority: HIGHEST for action security_group_members [ 907.594728] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc98288b-6b97-448c-a5b8-54058cb0d341 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.594728] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc98288b-6b97-448c-a5b8-54058cb0d341" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.594728] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc98288b-6b97-448c-a5b8-54058cb0d341" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.594728] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc98288b-6b97-448c-a5b8-54058cb0d341" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.594728] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.594728] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.594728] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.594728] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.595143] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.595143] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc98288b-6b97-448c-a5b8-54058cb0d341',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.882117] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 in Status: SUCCESS [ 907.882415] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 deletion is rescheduled due to dependency. [ 907.882415] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.882598] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.882801] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.882992] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.883124] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.883180] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.883332] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.883437] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.883551] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e90c0f27-4513-40eb-ba31-bf40f699d9a6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.015217] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.015217] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.015217] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.015217] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.015217] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.015217] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8f09afb-feb2-4daf-94fc-fd2a5be18745 already deleted. [ 908.015217] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8f09afb-feb2-4daf-94fc-fd2a5be18745" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.085313] env[62842]: INFO networking_nsxv3.common.synchronization [req-4897c91b-b36a-4b5f-ac03-cb38e230a545 req-e7122603-78fe-4d4d-95aa-a693ef321f2e tempest-SecurityGroupRulesTestJSON-1776752636 tempest-SecurityGroupRulesTestJSON-1776752636-project-member] Enqueued Resource ID: 690f170a-7c70-4ed3-8cbf-6b955eacbd66 with Priority: HIGHEST for action security_group_rules [ 908.085313] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 690f170a-7c70-4ed3-8cbf-6b955eacbd66 with Priority: HIGHEST for action security_group_rules [ 908.085313] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-690f170a-7c70-4ed3-8cbf-6b955eacbd66 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.085793] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-690f170a-7c70-4ed3-8cbf-6b955eacbd66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.085963] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-690f170a-7c70-4ed3-8cbf-6b955eacbd66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.087029] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-690f170a-7c70-4ed3-8cbf-6b955eacbd66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.087341] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('690f170a-7c70-4ed3-8cbf-6b955eacbd66',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.099160] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.099160] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.099160] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.099368] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.099450] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.099639] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.099735] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.099797] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.100233] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.100233] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.100233] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc98288b-6b97-448c-a5b8-54058cb0d341 already deleted. [ 908.100233] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc98288b-6b97-448c-a5b8-54058cb0d341" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.101816] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-917 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.101998] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-917" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.103924] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-917" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.104504] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-917" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.105090] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.105307] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.105478] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.105701] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.105846] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.106283] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 908.106283] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 908.106283] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 908.106393] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 908.106498] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 908.106606] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 908.106742] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 908.128346] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 908.128540] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 908.128700] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 908.129586] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-917" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.130541] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-1bef2318-ce9a-4732-a411-a599b0a90b2e taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.130541] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-1bef2318-ce9a-4732-a411-a599b0a90b2e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.130541] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-1bef2318-ce9a-4732-a411-a599b0a90b2e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.130719] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-1bef2318-ce9a-4732-a411-a599b0a90b2e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.130834] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1bef2318-ce9a-4732-a411-a599b0a90b2e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.217319] env[62842]: INFO networking_nsxv3.common.synchronization [req-a9c83ff3-3b97-40f8-9ae1-bfe2b6c5b03f req-231ba355-7f4c-46f7-8eba-edbc41a56055 tempest-SecurityGroupRulesTestJSON-1776752636 tempest-SecurityGroupRulesTestJSON-1776752636-project-member] Enqueued Resource ID: 690f170a-7c70-4ed3-8cbf-6b955eacbd66 with Priority: HIGHEST for action security_group_rules [ 908.218276] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 690f170a-7c70-4ed3-8cbf-6b955eacbd66 with Priority: HIGHEST for action security_group_rules [ 908.218684] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-690f170a-7c70-4ed3-8cbf-6b955eacbd66 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.218848] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-690f170a-7c70-4ed3-8cbf-6b955eacbd66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.389226] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.389382] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.389699] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.389984] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.390122] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.390304] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.390462] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.390462] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.390724] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.390724] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.390890] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 is going to be updated. [ 908.418946] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.418946] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.418946] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.419409] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.419558] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.429908] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 in Status: IN_PROGRESS for 2s [ 908.570723] env[62842]: INFO networking_nsxv3.common.synchronization [req-2fa67df1-9e17-47d4-b33a-b8931765e7c0 req-e39aee03-759f-4ccc-9fce-c9de1bc35628 tempest-SecurityGroupRulesTestJSON-1776752636 tempest-SecurityGroupRulesTestJSON-1776752636-project-member] Enqueued Resource ID: 690f170a-7c70-4ed3-8cbf-6b955eacbd66 with Priority: HIGHEST for action security_group_rules [ 908.571384] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 690f170a-7c70-4ed3-8cbf-6b955eacbd66 with Priority: HIGHEST for action security_group_rules [ 908.571793] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-690f170a-7c70-4ed3-8cbf-6b955eacbd66 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.572237] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-690f170a-7c70-4ed3-8cbf-6b955eacbd66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.617422] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.618861] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.618861] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.618861] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.618861] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.618861] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 690f170a-7c70-4ed3-8cbf-6b955eacbd66 already deleted. [ 908.618861] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-690f170a-7c70-4ed3-8cbf-6b955eacbd66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.618861] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-690f170a-7c70-4ed3-8cbf-6b955eacbd66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.618861] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-690f170a-7c70-4ed3-8cbf-6b955eacbd66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.618861] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('690f170a-7c70-4ed3-8cbf-6b955eacbd66',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.634293] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.634497] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.634627] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.634910] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.635250] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.635250] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 1bef2318-ce9a-4732-a411-a599b0a90b2e not found, creating... [ 908.635493] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.635653] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.635775] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.636073] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.636133] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.636423] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.636662] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.636799] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.637127] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.637205] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.637351] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 1bef2318-ce9a-4732-a411-a599b0a90b2e is going to be created. [ 908.670165] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.670411] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.670514] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.670913] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.671228] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.671508] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-1bef2318-ce9a-4732-a411-a599b0a90b2e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.141235] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.142138] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.142270] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.142495] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.142580] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.142679] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 690f170a-7c70-4ed3-8cbf-6b955eacbd66 already deleted. [ 909.142765] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-690f170a-7c70-4ed3-8cbf-6b955eacbd66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.143298] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-690f170a-7c70-4ed3-8cbf-6b955eacbd66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.143462] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-690f170a-7c70-4ed3-8cbf-6b955eacbd66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.143548] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('690f170a-7c70-4ed3-8cbf-6b955eacbd66',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.627518] env[62842]: INFO networking_nsxv3.common.synchronization [req-b7d4027c-b481-495c-ad8c-5c13d38fe657 req-b326f602-bf4c-4df2-aa77-858df91c8117 service nova] Enqueued Resource ID: bc98288b-6b97-448c-a5b8-54058cb0d341 with Priority: HIGHEST for action security_group_rules [ 909.627820] env[62842]: INFO networking_nsxv3.common.synchronization [req-b7d4027c-b481-495c-ad8c-5c13d38fe657 req-b326f602-bf4c-4df2-aa77-858df91c8117 service nova] Enqueued Resource ID: bc98288b-6b97-448c-a5b8-54058cb0d341 with Priority: HIGHEST for action security_group_members [ 909.627869] env[62842]: INFO networking_nsxv3.common.synchronization [req-b7d4027c-b481-495c-ad8c-5c13d38fe657 req-b326f602-bf4c-4df2-aa77-858df91c8117 service nova] Enqueued Resource ID: 1bef2318-ce9a-4732-a411-a599b0a90b2e with Priority: HIGHEST for action port [ 909.628083] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc98288b-6b97-448c-a5b8-54058cb0d341 with Priority: HIGHEST for action security_group_rules [ 909.628209] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc98288b-6b97-448c-a5b8-54058cb0d341 with Priority: HIGHEST for action security_group_members [ 909.628307] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bef2318-ce9a-4732-a411-a599b0a90b2e with Priority: HIGHEST for action port [ 909.632584] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc98288b-6b97-448c-a5b8-54058cb0d341 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.632718] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc98288b-6b97-448c-a5b8-54058cb0d341" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.632787] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc98288b-6b97-448c-a5b8-54058cb0d341" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.633027] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc98288b-6b97-448c-a5b8-54058cb0d341" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.633118] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc98288b-6b97-448c-a5b8-54058cb0d341',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.634022] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc98288b-6b97-448c-a5b8-54058cb0d341 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.634154] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc98288b-6b97-448c-a5b8-54058cb0d341" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.634224] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc98288b-6b97-448c-a5b8-54058cb0d341" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.634393] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc98288b-6b97-448c-a5b8-54058cb0d341" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.634544] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.634639] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.634698] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.634893] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.634935] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.634997] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc98288b-6b97-448c-a5b8-54058cb0d341',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.635736] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-1bef2318-ce9a-4732-a411-a599b0a90b2e taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.635824] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1bef2318-ce9a-4732-a411-a599b0a90b2e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.635876] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1bef2318-ce9a-4732-a411-a599b0a90b2e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.636366] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1bef2318-ce9a-4732-a411-a599b0a90b2e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.636366] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1bef2318-ce9a-4732-a411-a599b0a90b2e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.666528] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.666689] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.666729] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.666928] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.667311] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.667311] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 690f170a-7c70-4ed3-8cbf-6b955eacbd66 already deleted. [ 909.667311] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-690f170a-7c70-4ed3-8cbf-6b955eacbd66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.045304] env[62842]: INFO networking_nsxv3.common.synchronization [req-16842e6c-878a-4728-ba15-1c44d155f076 req-f5d85fb7-b4cf-4b5c-8167-d1976740fa50 tempest-ServersAdminNegativeTestJSON-1401896846 tempest-ServersAdminNegativeTestJSON-1401896846-project-member] Enqueued Resource ID: b47c6fcc-dd2d-4dd3-979a-610c0739cfd0 with Priority: HIGHEST for action security_group_members [ 910.045850] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b47c6fcc-dd2d-4dd3-979a-610c0739cfd0 with Priority: HIGHEST for action security_group_members [ 910.050358] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.050524] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.050589] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.050812] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.050982] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.051094] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.051156] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.051341] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.051495] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.051587] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b47c6fcc-dd2d-4dd3-979a-610c0739cfd0',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.137369] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bc98288b-6b97-448c-a5b8-54058cb0d341',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.138434] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc98288b-6b97-448c-a5b8-54058cb0d341 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.138569] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc98288b-6b97-448c-a5b8-54058cb0d341" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.138986] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1bef2318-ce9a-4732-a411-a599b0a90b2e with status ACTIVE [ 910.139053] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.143192] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.143192] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.143192] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.143192] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.143192] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.143192] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.143192] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.143192] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.143192] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.143192] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.143192] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.143192] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.143192] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.143192] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.143192] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1bef2318-ce9a-4732-a411-a599b0a90b2e is going to be updated. [ 910.164292] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.164458] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.164496] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.164702] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.164862] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.164997] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1bef2318-ce9a-4732-a411-a599b0a90b2e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.443173] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 in Status: SUCCESS [ 910.443310] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 deletion is rescheduled due to dependency. [ 910.443521] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.559304] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b47c6fcc-dd2d-4dd3-979a-610c0739cfd0',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.640018] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bc98288b-6b97-448c-a5b8-54058cb0d341',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.063924] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b47c6fcc-dd2d-4dd3-979a-610c0739cfd0',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.143226] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.143422] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.143510] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.143722] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.143808] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.143905] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc98288b-6b97-448c-a5b8-54058cb0d341 is going to be created. [ 911.158513] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-938 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.158755] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-938" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.158881] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-938" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.159176] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-938" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.159450] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.159610] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.159731] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.159945] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.160363] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.160552] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 911.160685] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 911.160801] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 911.160914] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 911.161040] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 911.161152] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 911.161289] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 911.167927] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.168078] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.168127] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.168311] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.168497] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.182414] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc98288b-6b97-448c-a5b8-54058cb0d341 in Status: UNINITIALIZED for 2s [ 911.184556] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 911.184718] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 911.184860] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 911.185053] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-938" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.185381] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-609a0576-af6d-427d-bf41-62c6f57f0c56 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.185557] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-609a0576-af6d-427d-bf41-62c6f57f0c56" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.185681] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-609a0576-af6d-427d-bf41-62c6f57f0c56" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.186053] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-609a0576-af6d-427d-bf41-62c6f57f0c56" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.186204] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('609a0576-af6d-427d-bf41-62c6f57f0c56',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.567655] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.567794] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.567833] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.568077] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.568166] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.568567] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b47c6fcc-dd2d-4dd3-979a-610c0739cfd0 is going to be updated. [ 911.598398] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.598398] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.598398] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.598398] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.598962] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.609957] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b47c6fcc-dd2d-4dd3-979a-610c0739cfd0 in Status: IN_PROGRESS for 2s [ 911.688231] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.688597] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.689833] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.690182] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.690367] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.690555] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 609a0576-af6d-427d-bf41-62c6f57f0c56 not found, creating... [ 911.691048] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.691576] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.691576] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.691576] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.692190] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.692687] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.693381] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.693593] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.694754] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.694754] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.694754] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 609a0576-af6d-427d-bf41-62c6f57f0c56 is going to be created. [ 911.717715] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.717974] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.718124] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.718428] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.718684] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.718921] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-609a0576-af6d-427d-bf41-62c6f57f0c56" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.607687] env[62842]: INFO networking_nsxv3.common.synchronization [req-1241596e-d3b4-48ab-a24d-70c9b07d6742 req-e60b205c-9d8c-453c-9b79-67b957298ea0 tempest-ServerDiskConfigTestJSON-797549774 tempest-ServerDiskConfigTestJSON-797549774-project-member] Enqueued Resource ID: c184a589-476a-49bd-9984-d339a77ec8f3 with Priority: HIGHEST for action security_group_members [ 912.608247] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c184a589-476a-49bd-9984-d339a77ec8f3 with Priority: HIGHEST for action security_group_members [ 912.610245] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-c184a589-476a-49bd-9984-d339a77ec8f3 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.610436] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.610544] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.610755] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.610913] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.611166] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.611166] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.611233] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.611299] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.611384] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c184a589-476a-49bd-9984-d339a77ec8f3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.612871] env[62842]: INFO networking_nsxv3.common.synchronization [req-16842e6c-878a-4728-ba15-1c44d155f076 req-e3057c3b-5bf0-4d64-bf6b-973194297e51 service nova] Enqueued Resource ID: b47c6fcc-dd2d-4dd3-979a-610c0739cfd0 with Priority: HIGHEST for action security_group_rules [ 912.612969] env[62842]: INFO networking_nsxv3.common.synchronization [req-16842e6c-878a-4728-ba15-1c44d155f076 req-e3057c3b-5bf0-4d64-bf6b-973194297e51 service nova] Enqueued Resource ID: b47c6fcc-dd2d-4dd3-979a-610c0739cfd0 with Priority: HIGHEST for action security_group_members [ 912.613311] env[62842]: INFO networking_nsxv3.common.synchronization [req-16842e6c-878a-4728-ba15-1c44d155f076 req-e3057c3b-5bf0-4d64-bf6b-973194297e51 service nova] Enqueued Resource ID: 609a0576-af6d-427d-bf41-62c6f57f0c56 with Priority: HIGHEST for action port [ 912.614832] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b47c6fcc-dd2d-4dd3-979a-610c0739cfd0 with Priority: HIGHEST for action security_group_rules [ 912.614832] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b47c6fcc-dd2d-4dd3-979a-610c0739cfd0 with Priority: HIGHEST for action security_group_members [ 912.614832] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 609a0576-af6d-427d-bf41-62c6f57f0c56 with Priority: HIGHEST for action port [ 912.615706] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.615819] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.615906] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.616106] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.616183] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b47c6fcc-dd2d-4dd3-979a-610c0739cfd0',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.617474] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.617619] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.617864] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-609a0576-af6d-427d-bf41-62c6f57f0c56 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.617949] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-609a0576-af6d-427d-bf41-62c6f57f0c56" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.618114] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-609a0576-af6d-427d-bf41-62c6f57f0c56" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.618302] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-609a0576-af6d-427d-bf41-62c6f57f0c56" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.618384] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('609a0576-af6d-427d-bf41-62c6f57f0c56',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.119542] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.119802] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.119802] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.119988] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.120068] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.120230] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.120353] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.120394] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.120523] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.120606] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.120732] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c184a589-476a-49bd-9984-d339a77ec8f3 is going to be updated. [ 913.122368] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.122368] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.122368] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 609a0576-af6d-427d-bf41-62c6f57f0c56 with status ACTIVE [ 913.122591] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.122591] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.122591] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.124216] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.124612] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.124612] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.124612] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.124612] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.124799] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.124847] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.125012] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.125108] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.125168] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.125303] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.125377] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.125731] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 609a0576-af6d-427d-bf41-62c6f57f0c56 is going to be updated. [ 913.132939] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-51 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.133066] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-51" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.133152] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-51" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.133393] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-51" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.133649] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.133895] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.133960] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.134142] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.134284] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.134486] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 913.134602] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 913.134714] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 913.134823] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 913.134934] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 913.136135] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 913.136217] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 913.156239] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 913.156239] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 913.156363] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 913.156518] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-51" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.156819] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-6ceb3fa2-c9e1-4730-ba0a-cef8f82f909b taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.157132] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-6ceb3fa2-c9e1-4730-ba0a-cef8f82f909b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.157214] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-6ceb3fa2-c9e1-4730-ba0a-cef8f82f909b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.158030] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-6ceb3fa2-c9e1-4730-ba0a-cef8f82f909b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.158030] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ceb3fa2-c9e1-4730-ba0a-cef8f82f909b',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.161119] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.161253] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.161327] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.161663] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.161739] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.161864] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-609a0576-af6d-427d-bf41-62c6f57f0c56" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.162757] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.162873] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.162940] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.163168] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.163288] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.175295] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c184a589-476a-49bd-9984-d339a77ec8f3 in Status: IN_PROGRESS for 2s [ 913.192313] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc98288b-6b97-448c-a5b8-54058cb0d341 in Status: SUCCESS [ 913.192840] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc98288b-6b97-448c-a5b8-54058cb0d341" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.193336] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc98288b-6b97-448c-a5b8-54058cb0d341" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.194031] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc98288b-6b97-448c-a5b8-54058cb0d341" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.194031] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.194031] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.194031] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.194268] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.194268] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.194268] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc98288b-6b97-448c-a5b8-54058cb0d341" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.194367] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bc98288b-6b97-448c-a5b8-54058cb0d341',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.554167] env[62842]: INFO networking_nsxv3.common.synchronization [req-121ed28c-aac3-4695-b839-1778bc0e01ff req-abe4bf1f-6358-4da7-a006-d31f7dc7221b tempest-DeleteServersTestJSON-1113791748 tempest-DeleteServersTestJSON-1113791748-project-member] Enqueued Resource ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 with Priority: HIGHEST for action security_group_members [ 913.554713] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 with Priority: HIGHEST for action security_group_members [ 913.554980] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-35146777-fd28-4ac7-b454-f7dd3fbb5846 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.555644] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.555644] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.555644] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.555644] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.555644] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.555875] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.555875] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.555875] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.555964] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('35146777-fd28-4ac7-b454-f7dd3fbb5846',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.623518] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b47c6fcc-dd2d-4dd3-979a-610c0739cfd0 in Status: SUCCESS [ 913.623806] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.623979] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.624244] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.624437] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.624559] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.624659] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.624775] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.624854] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.624949] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b47c6fcc-dd2d-4dd3-979a-610c0739cfd0',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.665685] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.665914] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.666058] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.666364] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.666519] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.666682] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 6ceb3fa2-c9e1-4730-ba0a-cef8f82f909b not found, creating... [ 913.667337] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.667512] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.667639] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.668059] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.668420] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.669097] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.669342] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.669421] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.669660] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.669847] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.670046] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 6ceb3fa2-c9e1-4730-ba0a-cef8f82f909b is going to be created. [ 913.696934] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bc98288b-6b97-448c-a5b8-54058cb0d341',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.699633] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.700330] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.700330] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.701193] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.701193] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.701193] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-6ceb3fa2-c9e1-4730-ba0a-cef8f82f909b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.062108] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.062108] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.062308] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.062398] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.065871] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.065871] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.065871] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.065871] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.065871] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.065871] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.065871] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 is going to be updated. [ 914.089901] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.090062] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.090720] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.090720] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.090720] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.100393] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 in Status: IN_PROGRESS for 2s [ 914.127761] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b47c6fcc-dd2d-4dd3-979a-610c0739cfd0',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.202597] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bc98288b-6b97-448c-a5b8-54058cb0d341: rpc.has_security_group_logging(os_id): False [ 914.221807] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.222243] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.222359] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.223193] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.223193] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.223193] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.223407] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.223407] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.223557] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.223590] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.223694] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc98288b-6b97-448c-a5b8-54058cb0d341 is going to be created. [ 914.291559] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.291559] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.291559] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.291559] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.291559] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.301462] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc98288b-6b97-448c-a5b8-54058cb0d341 in Status: IN_PROGRESS for 2s [ 914.632194] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b47c6fcc-dd2d-4dd3-979a-610c0739cfd0',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.716676] env[62842]: INFO networking_nsxv3.common.synchronization [req-1241596e-d3b4-48ab-a24d-70c9b07d6742 req-3d9b7413-30c8-40ea-83cf-142bcf0d10c7 service nova] Enqueued Resource ID: c184a589-476a-49bd-9984-d339a77ec8f3 with Priority: HIGHEST for action security_group_rules [ 914.716950] env[62842]: INFO networking_nsxv3.common.synchronization [req-1241596e-d3b4-48ab-a24d-70c9b07d6742 req-3d9b7413-30c8-40ea-83cf-142bcf0d10c7 service nova] Enqueued Resource ID: c184a589-476a-49bd-9984-d339a77ec8f3 with Priority: HIGHEST for action security_group_members [ 914.717044] env[62842]: INFO networking_nsxv3.common.synchronization [req-1241596e-d3b4-48ab-a24d-70c9b07d6742 req-3d9b7413-30c8-40ea-83cf-142bcf0d10c7 service nova] Enqueued Resource ID: 6ceb3fa2-c9e1-4730-ba0a-cef8f82f909b with Priority: HIGHEST for action port [ 914.717319] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c184a589-476a-49bd-9984-d339a77ec8f3 with Priority: HIGHEST for action security_group_rules [ 914.717457] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c184a589-476a-49bd-9984-d339a77ec8f3 with Priority: HIGHEST for action security_group_members [ 914.717554] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ceb3fa2-c9e1-4730-ba0a-cef8f82f909b with Priority: HIGHEST for action port [ 914.725029] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c184a589-476a-49bd-9984-d339a77ec8f3 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.725029] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.725029] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.725029] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.725029] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c184a589-476a-49bd-9984-d339a77ec8f3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.725029] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-c184a589-476a-49bd-9984-d339a77ec8f3 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.725029] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.725029] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ceb3fa2-c9e1-4730-ba0a-cef8f82f909b taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.725589] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ceb3fa2-c9e1-4730-ba0a-cef8f82f909b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.725589] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ceb3fa2-c9e1-4730-ba0a-cef8f82f909b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.726212] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ceb3fa2-c9e1-4730-ba0a-cef8f82f909b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.726212] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ceb3fa2-c9e1-4730-ba0a-cef8f82f909b',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.875541] env[62842]: INFO networking_nsxv3.common.synchronization [req-1bbf4204-538c-4d13-8011-927bce56f9d2 req-b8131c4a-e4ac-4a02-bb29-07db49f68e36 tempest-ServersTestJSON-1267616671 tempest-ServersTestJSON-1267616671-project-member] Enqueued Resource ID: 074be4e0-ffc9-4ec9-b29a-40406844218c with Priority: HIGHEST for action security_group_members [ 914.876421] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 074be4e0-ffc9-4ec9-b29a-40406844218c with Priority: HIGHEST for action security_group_members [ 914.877118] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-074be4e0-ffc9-4ec9-b29a-40406844218c taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.877417] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.877511] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.877866] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.878161] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.878325] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.878359] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.878583] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.878680] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.878779] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.139304] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.139767] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.139767] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.139767] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.140056] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.140056] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b47c6fcc-dd2d-4dd3-979a-610c0739cfd0 is going to be updated. [ 915.172117] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.172352] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.172352] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.172576] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.172785] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.184745] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b47c6fcc-dd2d-4dd3-979a-610c0739cfd0 in Status: IN_PROGRESS for 2s [ 915.187839] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c184a589-476a-49bd-9984-d339a77ec8f3 in Status: SUCCESS [ 915.187839] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c184a589-476a-49bd-9984-d339a77ec8f3 deletion is rescheduled due to dependency. [ 915.187839] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.187839] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.187839] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.187839] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.187839] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.187839] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.187839] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.187839] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.187839] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c184a589-476a-49bd-9984-d339a77ec8f3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.229421] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-c184a589-476a-49bd-9984-d339a77ec8f3 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.229421] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.230439] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6ceb3fa2-c9e1-4730-ba0a-cef8f82f909b with status ACTIVE [ 915.230782] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.230782] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.230914] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.231074] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.231162] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.231350] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.231456] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.231526] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.231702] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.231781] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.231965] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.232161] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.232161] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.232324] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.232324] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.232425] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6ceb3fa2-c9e1-4730-ba0a-cef8f82f909b is going to be updated. [ 915.255536] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.255536] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.255536] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.255767] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.255837] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.255990] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ceb3fa2-c9e1-4730-ba0a-cef8f82f909b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.381281] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.381281] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.381553] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.381655] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.381777] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.382039] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.382161] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.382269] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.382416] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.382512] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.382628] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 074be4e0-ffc9-4ec9-b29a-40406844218c already deleted. [ 915.382692] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.479904] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-509 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.480212] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-509" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.480212] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-509" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.480677] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-509" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.480993] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.481209] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.481353] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.481683] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.481834] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.482162] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 915.482235] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 915.482353] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 915.482468] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 915.482586] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 915.482699] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 915.482943] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 915.509219] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 915.509219] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 915.509219] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 915.509219] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-509" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.509219] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-b07415e9-9ae7-4ac5-99c5-9a0ce1c491ba taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.509219] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-b07415e9-9ae7-4ac5-99c5-9a0ce1c491ba" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.509219] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-b07415e9-9ae7-4ac5-99c5-9a0ce1c491ba" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.509219] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-b07415e9-9ae7-4ac5-99c5-9a0ce1c491ba" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.509219] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b07415e9-9ae7-4ac5-99c5-9a0ce1c491ba',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.690651] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c184a589-476a-49bd-9984-d339a77ec8f3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.013976] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.014257] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.014434] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.015972] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.015972] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.015972] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port b07415e9-9ae7-4ac5-99c5-9a0ce1c491ba not found, creating... [ 916.015972] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.015972] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.015972] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.015972] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.016415] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.016415] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.016501] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.016626] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.016799] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.016927] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.018639] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: b07415e9-9ae7-4ac5-99c5-9a0ce1c491ba is going to be created. [ 916.041072] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.041995] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.043316] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.043316] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.043316] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.043768] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-b07415e9-9ae7-4ac5-99c5-9a0ce1c491ba" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.112239] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 in Status: SUCCESS [ 916.112479] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 deletion is rescheduled due to dependency. [ 916.112571] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.193521] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c184a589-476a-49bd-9984-d339a77ec8f3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.315661] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc98288b-6b97-448c-a5b8-54058cb0d341 in Status: SUCCESS [ 916.315661] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc98288b-6b97-448c-a5b8-54058cb0d341" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.698817] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.699052] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.699052] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.699274] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.699373] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.699477] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c184a589-476a-49bd-9984-d339a77ec8f3 is going to be updated. [ 916.735892] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.735985] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.735985] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.736230] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.736438] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.746745] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c184a589-476a-49bd-9984-d339a77ec8f3 in Status: IN_PROGRESS for 2s [ 916.967527] env[62842]: INFO networking_nsxv3.common.synchronization [None req-931cf297-4bf5-4687-82e4-d0327a15166e None None] Enqueued Resource ID: 8034dcf6-8b08-48af-8295-10f509dd5344 with Priority: HIGHEST for action port [ 916.967807] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8034dcf6-8b08-48af-8295-10f509dd5344 with Priority: HIGHEST for action port [ 916.968454] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-8034dcf6-8b08-48af-8295-10f509dd5344 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.968622] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8034dcf6-8b08-48af-8295-10f509dd5344" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.969314] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8034dcf6-8b08-48af-8295-10f509dd5344" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.969457] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8034dcf6-8b08-48af-8295-10f509dd5344" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.969576] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8034dcf6-8b08-48af-8295-10f509dd5344',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.196877] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b47c6fcc-dd2d-4dd3-979a-610c0739cfd0 in Status: SUCCESS [ 917.197291] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.197291] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.197428] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.197623] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.197742] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.197807] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.197951] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.198042] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.198128] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.198219] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b47c6fcc-dd2d-4dd3-979a-610c0739cfd0',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.475753] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8034dcf6-8b08-48af-8295-10f509dd5344 [ 917.476025] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.476181] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.476258] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.476458] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.476546] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.476658] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8034dcf6-8b08-48af-8295-10f509dd5344 already deleted. [ 917.477019] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8034dcf6-8b08-48af-8295-10f509dd5344" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.537664] env[62842]: INFO networking_nsxv3.common.synchronization [req-1bbf4204-538c-4d13-8011-927bce56f9d2 req-99d90e1f-dbce-4bd7-8e0c-9886f93e7f6e service nova] Enqueued Resource ID: 074be4e0-ffc9-4ec9-b29a-40406844218c with Priority: HIGHEST for action security_group_rules [ 917.537846] env[62842]: INFO networking_nsxv3.common.synchronization [req-1bbf4204-538c-4d13-8011-927bce56f9d2 req-99d90e1f-dbce-4bd7-8e0c-9886f93e7f6e service nova] Enqueued Resource ID: 074be4e0-ffc9-4ec9-b29a-40406844218c with Priority: HIGHEST for action security_group_members [ 917.537988] env[62842]: INFO networking_nsxv3.common.synchronization [req-1bbf4204-538c-4d13-8011-927bce56f9d2 req-99d90e1f-dbce-4bd7-8e0c-9886f93e7f6e service nova] Enqueued Resource ID: b07415e9-9ae7-4ac5-99c5-9a0ce1c491ba with Priority: HIGHEST for action port [ 917.538378] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 074be4e0-ffc9-4ec9-b29a-40406844218c with Priority: HIGHEST for action security_group_rules [ 917.538441] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 074be4e0-ffc9-4ec9-b29a-40406844218c with Priority: HIGHEST for action security_group_members [ 917.538558] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b07415e9-9ae7-4ac5-99c5-9a0ce1c491ba with Priority: HIGHEST for action port [ 917.539476] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-074be4e0-ffc9-4ec9-b29a-40406844218c taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.539609] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.539675] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.539969] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.540019] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.540953] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-074be4e0-ffc9-4ec9-b29a-40406844218c taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.541064] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.545021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.545021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.545021] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.545021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.545021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.545021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.545021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.545021] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.545021] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-b07415e9-9ae7-4ac5-99c5-9a0ce1c491ba taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.545021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b07415e9-9ae7-4ac5-99c5-9a0ce1c491ba" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.545021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b07415e9-9ae7-4ac5-99c5-9a0ce1c491ba" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.545021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b07415e9-9ae7-4ac5-99c5-9a0ce1c491ba" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.545021] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b07415e9-9ae7-4ac5-99c5-9a0ce1c491ba',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.701197] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.702947] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.702947] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.702947] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.702947] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.702947] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.702947] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.702947] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.702947] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.702947] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.702947] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.702947] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.702947] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.702947] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.703493] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.703713] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.703713] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.703942] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.705596] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.705596] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.705596] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b47c6fcc-dd2d-4dd3-979a-610c0739cfd0',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.046228] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-074be4e0-ffc9-4ec9-b29a-40406844218c taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.046228] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.054433] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.054433] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b07415e9-9ae7-4ac5-99c5-9a0ce1c491ba with status ACTIVE [ 918.054433] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.054433] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.054433] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.054433] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.054433] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.054433] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.054433] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.054433] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.054433] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.054433] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.054433] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.055691] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.055909] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.056247] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.056428] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.056651] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b07415e9-9ae7-4ac5-99c5-9a0ce1c491ba is going to be updated. [ 918.081939] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.081939] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.081939] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.081939] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.081939] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.081939] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b07415e9-9ae7-4ac5-99c5-9a0ce1c491ba" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.208098] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b47c6fcc-dd2d-4dd3-979a-610c0739cfd0: rpc.has_security_group_logging(os_id): False [ 918.233529] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.237288] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.237288] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.237826] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.237934] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.238337] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.238500] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.238768] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.239474] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.239474] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.239474] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.239635] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.239669] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.239817] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.239894] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.240543] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.240717] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.241028] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.241186] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.241278] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.241432] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b47c6fcc-dd2d-4dd3-979a-610c0739cfd0 is going to be updated. [ 918.316345] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.317739] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.317739] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.317870] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.321024] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.336914] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b47c6fcc-dd2d-4dd3-979a-610c0739cfd0 in Status: IN_PROGRESS for 2s [ 918.562380] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.756831] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c184a589-476a-49bd-9984-d339a77ec8f3 in Status: SUCCESS [ 918.760021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.760021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.760021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.760021] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.760021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.760021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.760021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.760021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.760021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.760021] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c184a589-476a-49bd-9984-d339a77ec8f3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.064081] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.064236] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.064320] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.064547] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.064687] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.064994] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 074be4e0-ffc9-4ec9-b29a-40406844218c is going to be created. [ 919.097394] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.097528] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.097528] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.097875] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.097930] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.123595] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 074be4e0-ffc9-4ec9-b29a-40406844218c in Status: UNINITIALIZED for 2s [ 919.261607] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-c184a589-476a-49bd-9984-d339a77ec8f3 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.262032] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.262032] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.262152] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.262303] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.262442] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.262505] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.262618] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.262707] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.262795] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.262971] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-c184a589-476a-49bd-9984-d339a77ec8f3 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.263087] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.263152] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.263298] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.263438] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.263530] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.263590] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.263935] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.264046] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.264133] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.264222] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c184a589-476a-49bd-9984-d339a77ec8f3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.421985] env[62842]: INFO networking_nsxv3.common.synchronization [None req-6605441e-5798-4c08-abb4-d46acd8f811c None None] Enqueued Resource ID: bb314bc2-5a0f-40bd-a22d-8a99a4b23ef8 with Priority: HIGHEST for action port [ 919.423347] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb314bc2-5a0f-40bd-a22d-8a99a4b23ef8 with Priority: HIGHEST for action port [ 919.423347] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb314bc2-5a0f-40bd-a22d-8a99a4b23ef8 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.423347] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb314bc2-5a0f-40bd-a22d-8a99a4b23ef8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.423347] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb314bc2-5a0f-40bd-a22d-8a99a4b23ef8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.423590] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb314bc2-5a0f-40bd-a22d-8a99a4b23ef8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.423679] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb314bc2-5a0f-40bd-a22d-8a99a4b23ef8',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.655578] env[62842]: INFO networking_nsxv3.common.synchronization [req-8f0deb9a-0b90-4b7d-91d7-f22e147dae25 req-94d4b727-ba2e-458f-88d4-7a7db790593d tempest-FloatingIPsAssociationTestJSON-1346363058 tempest-FloatingIPsAssociationTestJSON-1346363058-project-member] Enqueued Resource ID: 47118de8-4ba9-49a6-bc4b-d030be1e7c79 with Priority: HIGHEST for action security_group_members [ 919.656483] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47118de8-4ba9-49a6-bc4b-d030be1e7c79 with Priority: HIGHEST for action security_group_members [ 919.657107] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-47118de8-4ba9-49a6-bc4b-d030be1e7c79 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.657429] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.657599] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.658187] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.658187] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.658414] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.658580] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.659744] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.659744] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.659744] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47118de8-4ba9-49a6-bc4b-d030be1e7c79',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.769116] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c184a589-476a-49bd-9984-d339a77ec8f3: rpc.has_security_group_logging(os_id): False [ 919.800183] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.800183] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.800183] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.800960] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.800960] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.800960] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.800960] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.800960] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.801272] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.801272] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.801432] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.801565] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.801632] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.801812] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.801866] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.802117] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.802236] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.802296] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.802472] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.802559] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.802661] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c184a589-476a-49bd-9984-d339a77ec8f3 is going to be updated. [ 919.879715] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.879715] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.879715] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.879715] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.879715] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.896765] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c184a589-476a-49bd-9984-d339a77ec8f3 in Status: IN_PROGRESS for 2s [ 919.926957] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bb314bc2-5a0f-40bd-a22d-8a99a4b23ef8 [ 919.927367] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.927541] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.927614] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.927829] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.927923] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.928179] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bb314bc2-5a0f-40bd-a22d-8a99a4b23ef8 already deleted. [ 919.928179] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb314bc2-5a0f-40bd-a22d-8a99a4b23ef8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.162351] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('47118de8-4ba9-49a6-bc4b-d030be1e7c79',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.356248] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b47c6fcc-dd2d-4dd3-979a-610c0739cfd0 in Status: SUCCESS [ 920.356556] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.599302] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-631 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.599302] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-631" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.599302] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-631" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.599302] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-631" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.599302] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.599519] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.599519] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.601439] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.601439] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.601439] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 920.601439] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 920.601439] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 920.601439] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 920.601736] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 920.601736] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 920.601793] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 920.624498] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 920.624717] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 920.624921] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 920.625186] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-631" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.625576] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-e90a9f34-c7da-4130-8567-5bf5bff90a44 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.625752] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-e90a9f34-c7da-4130-8567-5bf5bff90a44" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.625930] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-e90a9f34-c7da-4130-8567-5bf5bff90a44" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.626519] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-e90a9f34-c7da-4130-8567-5bf5bff90a44" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.626695] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e90a9f34-c7da-4130-8567-5bf5bff90a44',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.665659] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('47118de8-4ba9-49a6-bc4b-d030be1e7c79',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.131263] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.131602] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.131840] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.132228] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.132397] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.132575] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port e90a9f34-c7da-4130-8567-5bf5bff90a44 not found, creating... [ 921.132867] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.133064] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.133305] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.133663] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.133834] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.134422] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.134694] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.134900] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.135161] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.135398] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.135688] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: e90a9f34-c7da-4130-8567-5bf5bff90a44 is going to be created. [ 921.138546] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 074be4e0-ffc9-4ec9-b29a-40406844218c in Status: SUCCESS [ 921.138867] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.139082] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.139294] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.139470] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.139758] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.139758] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.139817] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.139847] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.139923] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.141220] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.161199] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.161429] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.161565] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.161887] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.162141] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.162378] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-e90a9f34-c7da-4130-8567-5bf5bff90a44" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.168653] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.168856] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.168994] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.169259] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.169376] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.169495] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47118de8-4ba9-49a6-bc4b-d030be1e7c79 is going to be updated. [ 921.201846] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.201846] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.201846] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.201846] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.201846] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.211872] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47118de8-4ba9-49a6-bc4b-d030be1e7c79 in Status: IN_PROGRESS for 2s [ 921.644192] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-074be4e0-ffc9-4ec9-b29a-40406844218c taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.644492] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.644492] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.644622] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.644799] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.644950] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.645063] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.645224] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.645311] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.645413] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.645564] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-074be4e0-ffc9-4ec9-b29a-40406844218c taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.645659] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.645719] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.645858] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.645995] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.646098] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.646157] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.646365] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.646365] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.647192] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.647192] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.915209] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c184a589-476a-49bd-9984-d339a77ec8f3 in Status: SUCCESS [ 921.916648] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.149583] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 074be4e0-ffc9-4ec9-b29a-40406844218c: rpc.has_security_group_logging(os_id): False [ 922.173138] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.173138] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.173138] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.173138] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.173138] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.173138] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.173138] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.173138] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.176334] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.176486] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.176685] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.176787] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.177390] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.177390] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.177390] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.177390] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.177651] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.177651] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.177754] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.177754] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.177858] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 074be4e0-ffc9-4ec9-b29a-40406844218c is going to be created. [ 922.257563] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.257563] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.257563] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.257563] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.257563] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.270818] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 074be4e0-ffc9-4ec9-b29a-40406844218c in Status: IN_PROGRESS for 2s [ 922.575992] env[62842]: INFO networking_nsxv3.common.synchronization [req-8f0deb9a-0b90-4b7d-91d7-f22e147dae25 req-c34f4180-3617-405f-a501-d1004b30089c service nova] Enqueued Resource ID: 47118de8-4ba9-49a6-bc4b-d030be1e7c79 with Priority: HIGHEST for action security_group_rules [ 922.576209] env[62842]: INFO networking_nsxv3.common.synchronization [req-8f0deb9a-0b90-4b7d-91d7-f22e147dae25 req-c34f4180-3617-405f-a501-d1004b30089c service nova] Enqueued Resource ID: 47118de8-4ba9-49a6-bc4b-d030be1e7c79 with Priority: HIGHEST for action security_group_members [ 922.576369] env[62842]: INFO networking_nsxv3.common.synchronization [req-8f0deb9a-0b90-4b7d-91d7-f22e147dae25 req-c34f4180-3617-405f-a501-d1004b30089c service nova] Enqueued Resource ID: e90a9f34-c7da-4130-8567-5bf5bff90a44 with Priority: HIGHEST for action port [ 922.576644] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47118de8-4ba9-49a6-bc4b-d030be1e7c79 with Priority: HIGHEST for action security_group_rules [ 922.576948] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47118de8-4ba9-49a6-bc4b-d030be1e7c79 with Priority: HIGHEST for action security_group_members [ 922.577068] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e90a9f34-c7da-4130-8567-5bf5bff90a44 with Priority: HIGHEST for action port [ 922.578035] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47118de8-4ba9-49a6-bc4b-d030be1e7c79 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.578162] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.578227] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.578697] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.579033] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47118de8-4ba9-49a6-bc4b-d030be1e7c79',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.579962] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-47118de8-4ba9-49a6-bc4b-d030be1e7c79 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.580232] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.580488] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-e90a9f34-c7da-4130-8567-5bf5bff90a44 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.580605] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e90a9f34-c7da-4130-8567-5bf5bff90a44" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.580673] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e90a9f34-c7da-4130-8567-5bf5bff90a44" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.580856] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e90a9f34-c7da-4130-8567-5bf5bff90a44" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.580926] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e90a9f34-c7da-4130-8567-5bf5bff90a44',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.650758] env[62842]: INFO networking_nsxv3.common.synchronization [None req-89aee3bf-25d1-4f82-96b7-5a1b1e7eeaf7 None None] Enqueued Resource ID: 95e6c962-beeb-4790-8611-8da40dad9e67 with Priority: HIGHEST for action port [ 922.651347] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95e6c962-beeb-4790-8611-8da40dad9e67 with Priority: HIGHEST for action port [ 922.651667] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-95e6c962-beeb-4790-8611-8da40dad9e67 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.651814] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-95e6c962-beeb-4790-8611-8da40dad9e67" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.651882] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-95e6c962-beeb-4790-8611-8da40dad9e67" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.652215] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-95e6c962-beeb-4790-8611-8da40dad9e67" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.652311] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95e6c962-beeb-4790-8611-8da40dad9e67',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.084067] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-47118de8-4ba9-49a6-bc4b-d030be1e7c79 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.084067] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.090028] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e90a9f34-c7da-4130-8567-5bf5bff90a44 with status ACTIVE [ 923.090028] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.090028] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.090028] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.090028] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.090028] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.090028] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.090028] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.090028] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.090028] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.090028] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.090028] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.090028] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.090028] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.090028] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.090028] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.090028] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e90a9f34-c7da-4130-8567-5bf5bff90a44 is going to be updated. [ 923.120863] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.120863] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.120863] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.120863] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.120863] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.120863] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e90a9f34-c7da-4130-8567-5bf5bff90a44" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.154850] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 95e6c962-beeb-4790-8611-8da40dad9e67 [ 923.154850] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.154850] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.156038] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.156038] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.156038] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.156403] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:95e6c962-beeb-4790-8611-8da40dad9e67 already deleted. [ 923.157251] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-95e6c962-beeb-4790-8611-8da40dad9e67" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.227143] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47118de8-4ba9-49a6-bc4b-d030be1e7c79 in Status: SUCCESS [ 923.227459] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.227648] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.227940] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.228705] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.228705] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.228705] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.228945] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.228945] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.229013] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47118de8-4ba9-49a6-bc4b-d030be1e7c79',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.736897] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('47118de8-4ba9-49a6-bc4b-d030be1e7c79',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.060188] env[62842]: INFO networking_nsxv3.common.synchronization [req-5588ee3e-e87a-432d-b6d3-c11ddcaf4778 req-c0e3ada4-b9bf-4aa9-9a5a-e08535a4a7bd tempest-AttachInterfacesTestJSON-2140085841 tempest-AttachInterfacesTestJSON-2140085841-project-member] Enqueued Resource ID: ae20759e-0e4f-4e29-8897-7eb813e03b32 with Priority: HIGHEST for action security_group_members [ 924.060752] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae20759e-0e4f-4e29-8897-7eb813e03b32 with Priority: HIGHEST for action security_group_members [ 924.062382] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae20759e-0e4f-4e29-8897-7eb813e03b32 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.063331] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae20759e-0e4f-4e29-8897-7eb813e03b32" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.063331] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae20759e-0e4f-4e29-8897-7eb813e03b32" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.063331] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae20759e-0e4f-4e29-8897-7eb813e03b32" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.063331] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.063331] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.063331] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.063566] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.063602] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.066018] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae20759e-0e4f-4e29-8897-7eb813e03b32',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.244111] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('47118de8-4ba9-49a6-bc4b-d030be1e7c79',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.283129] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 074be4e0-ffc9-4ec9-b29a-40406844218c in Status: SUCCESS [ 924.283353] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.566075] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.566295] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.566393] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.566710] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.566821] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.567166] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.568459] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.568459] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.568459] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.568459] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.568459] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae20759e-0e4f-4e29-8897-7eb813e03b32 already deleted. [ 924.568459] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae20759e-0e4f-4e29-8897-7eb813e03b32" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.664733] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-416 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.665084] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-416" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.665314] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-416" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.665934] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-416" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.666279] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.666485] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.666910] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.667073] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.667259] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.667636] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 924.667934] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 924.668026] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 924.668516] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 924.668699] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 924.668869] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 924.668973] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 924.690561] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 924.690848] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 924.691021] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 924.691236] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-416" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.691566] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-726e1ba8-30d0-4002-802e-4f4a6a53f083 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.691794] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-726e1ba8-30d0-4002-802e-4f4a6a53f083" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.691925] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-726e1ba8-30d0-4002-802e-4f4a6a53f083" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.692567] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-726e1ba8-30d0-4002-802e-4f4a6a53f083" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.692567] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('726e1ba8-30d0-4002-802e-4f4a6a53f083',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.746218] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.746649] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.746649] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.746743] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.747417] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.747417] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47118de8-4ba9-49a6-bc4b-d030be1e7c79 is going to be updated. [ 924.777369] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.777559] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.777630] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.777920] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.778099] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.781636] env[62842]: INFO networking_nsxv3.common.synchronization [None req-afc27b34-00be-415a-b7e4-809a1ef7051a None None] Enqueued Resource ID: 23033e80-aced-4ce8-bcb8-8394cdb150cf with Priority: HIGHEST for action port [ 924.781940] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23033e80-aced-4ce8-bcb8-8394cdb150cf with Priority: HIGHEST for action port [ 924.782597] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-23033e80-aced-4ce8-bcb8-8394cdb150cf taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.782746] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23033e80-aced-4ce8-bcb8-8394cdb150cf" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.782822] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23033e80-aced-4ce8-bcb8-8394cdb150cf" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.783138] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23033e80-aced-4ce8-bcb8-8394cdb150cf" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.783242] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23033e80-aced-4ce8-bcb8-8394cdb150cf',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.789804] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47118de8-4ba9-49a6-bc4b-d030be1e7c79 in Status: IN_PROGRESS for 2s [ 925.196804] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.196804] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.196987] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.197179] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.197326] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.197485] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 726e1ba8-30d0-4002-802e-4f4a6a53f083 not found, creating... [ 925.197788] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.197953] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.198083] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.198311] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.198455] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.198994] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.199231] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.199371] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.199597] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.199795] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.199877] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 726e1ba8-30d0-4002-802e-4f4a6a53f083 is going to be created. [ 925.222683] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.222981] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.223216] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.223553] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.223887] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.224296] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-726e1ba8-30d0-4002-802e-4f4a6a53f083" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.286493] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 23033e80-aced-4ce8-bcb8-8394cdb150cf [ 925.286493] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.286493] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.286493] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.286493] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.286493] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.286493] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:23033e80-aced-4ce8-bcb8-8394cdb150cf already deleted. [ 925.286493] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23033e80-aced-4ce8-bcb8-8394cdb150cf" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.186218] env[62842]: INFO networking_nsxv3.common.synchronization [req-5588ee3e-e87a-432d-b6d3-c11ddcaf4778 req-a42a024a-63d1-4505-903a-94f380353cee service nova] Enqueued Resource ID: ae20759e-0e4f-4e29-8897-7eb813e03b32 with Priority: HIGHEST for action security_group_rules [ 926.186522] env[62842]: INFO networking_nsxv3.common.synchronization [req-5588ee3e-e87a-432d-b6d3-c11ddcaf4778 req-a42a024a-63d1-4505-903a-94f380353cee service nova] Enqueued Resource ID: ae20759e-0e4f-4e29-8897-7eb813e03b32 with Priority: HIGHEST for action security_group_members [ 926.186564] env[62842]: INFO networking_nsxv3.common.synchronization [req-5588ee3e-e87a-432d-b6d3-c11ddcaf4778 req-a42a024a-63d1-4505-903a-94f380353cee service nova] Enqueued Resource ID: 726e1ba8-30d0-4002-802e-4f4a6a53f083 with Priority: HIGHEST for action port [ 926.186768] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae20759e-0e4f-4e29-8897-7eb813e03b32 with Priority: HIGHEST for action security_group_rules [ 926.186898] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae20759e-0e4f-4e29-8897-7eb813e03b32 with Priority: HIGHEST for action security_group_members [ 926.187017] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 726e1ba8-30d0-4002-802e-4f4a6a53f083 with Priority: HIGHEST for action port [ 926.188052] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae20759e-0e4f-4e29-8897-7eb813e03b32 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.188191] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae20759e-0e4f-4e29-8897-7eb813e03b32" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.188259] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae20759e-0e4f-4e29-8897-7eb813e03b32" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.188458] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae20759e-0e4f-4e29-8897-7eb813e03b32" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.188624] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae20759e-0e4f-4e29-8897-7eb813e03b32',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.190202] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae20759e-0e4f-4e29-8897-7eb813e03b32 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.190202] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae20759e-0e4f-4e29-8897-7eb813e03b32" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.190202] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae20759e-0e4f-4e29-8897-7eb813e03b32" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.190202] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae20759e-0e4f-4e29-8897-7eb813e03b32" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.190202] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.190202] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.190202] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.190480] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.190480] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.190480] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae20759e-0e4f-4e29-8897-7eb813e03b32',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.191176] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-726e1ba8-30d0-4002-802e-4f4a6a53f083 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.191273] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-726e1ba8-30d0-4002-802e-4f4a6a53f083" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.191342] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-726e1ba8-30d0-4002-802e-4f4a6a53f083" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.191492] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-726e1ba8-30d0-4002-802e-4f4a6a53f083" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.191575] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('726e1ba8-30d0-4002-802e-4f4a6a53f083',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.693325] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae20759e-0e4f-4e29-8897-7eb813e03b32 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.693463] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae20759e-0e4f-4e29-8897-7eb813e03b32" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.694070] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ae20759e-0e4f-4e29-8897-7eb813e03b32',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.694650] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 726e1ba8-30d0-4002-802e-4f4a6a53f083 with status ACTIVE [ 926.694982] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.695153] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.695223] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.695436] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.695528] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.695715] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.695816] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.695868] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.696031] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.696109] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.696293] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.696381] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.696431] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.696571] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.696643] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.696752] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 726e1ba8-30d0-4002-802e-4f4a6a53f083 is going to be updated. [ 926.719298] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.719456] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.719527] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.719876] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.719876] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.720029] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-726e1ba8-30d0-4002-802e-4f4a6a53f083" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.801680] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47118de8-4ba9-49a6-bc4b-d030be1e7c79 in Status: SUCCESS [ 926.802019] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.802240] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.802535] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.802759] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.802947] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.803027] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.803258] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.804459] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.804459] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.804459] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('47118de8-4ba9-49a6-bc4b-d030be1e7c79',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.199875] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ae20759e-0e4f-4e29-8897-7eb813e03b32',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.307165] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-47118de8-4ba9-49a6-bc4b-d030be1e7c79 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.307377] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.307377] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.307646] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.307925] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.308074] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.308141] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.308351] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.308470] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.308680] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.308939] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-47118de8-4ba9-49a6-bc4b-d030be1e7c79 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.309051] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.309107] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.309869] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.309869] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.309869] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.309869] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.310153] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.310153] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.310250] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.310371] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('47118de8-4ba9-49a6-bc4b-d030be1e7c79',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.702153] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.702387] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.702473] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.702665] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.702771] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.702873] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae20759e-0e4f-4e29-8897-7eb813e03b32 is going to be created. [ 927.732676] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.732874] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.732951] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.733114] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.733273] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.742667] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae20759e-0e4f-4e29-8897-7eb813e03b32 in Status: UNINITIALIZED for 2s [ 927.814401] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 47118de8-4ba9-49a6-bc4b-d030be1e7c79: rpc.has_security_group_logging(os_id): False [ 927.835477] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.835620] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.835688] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.836239] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.836239] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.836430] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.836430] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.836520] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.836668] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.836745] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.836958] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.837067] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.837133] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.837292] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.837378] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.837583] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.837652] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.837716] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.837861] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.837935] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.838032] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47118de8-4ba9-49a6-bc4b-d030be1e7c79 is going to be updated. [ 927.910281] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.910732] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.910732] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.910810] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.910948] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.929315] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47118de8-4ba9-49a6-bc4b-d030be1e7c79 in Status: IN_PROGRESS for 2s [ 929.080993] env[62842]: INFO networking_nsxv3.common.synchronization [req-6b554e81-3d00-4871-b2c1-3a387ace292f req-1315b8da-3f50-42c0-980e-182913fda406 tempest-ServerAddressesTestJSON-844044825 tempest-ServerAddressesTestJSON-844044825-project-member] Enqueued Resource ID: 217e8514-093a-4d74-b378-a5091c69f5ba with Priority: HIGHEST for action security_group_members [ 929.084303] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 217e8514-093a-4d74-b378-a5091c69f5ba with Priority: HIGHEST for action security_group_members [ 929.084681] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-217e8514-093a-4d74-b378-a5091c69f5ba taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.084814] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-217e8514-093a-4d74-b378-a5091c69f5ba" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.084881] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-217e8514-093a-4d74-b378-a5091c69f5ba" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.085169] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-217e8514-093a-4d74-b378-a5091c69f5ba" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.085331] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.085476] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.085510] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.085651] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.085726] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.085823] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('217e8514-093a-4d74-b378-a5091c69f5ba',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.588792] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.588995] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.589078] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.589405] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.589541] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.589844] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.590037] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.590138] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.590402] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.590526] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.590742] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 217e8514-093a-4d74-b378-a5091c69f5ba already deleted. [ 929.590885] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-217e8514-093a-4d74-b378-a5091c69f5ba" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.592259] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-141 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.592467] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-141" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.592613] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-141" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.592972] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-141" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.593318] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.593475] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.593783] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.594115] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.594359] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.594526] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 929.594636] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 929.594754] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 929.594888] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 929.594985] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 929.595123] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 929.595306] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 929.624208] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 929.624208] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 929.624408] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 929.624590] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-141" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.624931] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-a16be442-33e0-4e8b-9e6b-0c1bb5d2e402 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.625135] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-a16be442-33e0-4e8b-9e6b-0c1bb5d2e402" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.625255] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-a16be442-33e0-4e8b-9e6b-0c1bb5d2e402" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.625614] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-a16be442-33e0-4e8b-9e6b-0c1bb5d2e402" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.625779] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a16be442-33e0-4e8b-9e6b-0c1bb5d2e402',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.755772] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae20759e-0e4f-4e29-8897-7eb813e03b32 in Status: SUCCESS [ 929.755772] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae20759e-0e4f-4e29-8897-7eb813e03b32" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.755772] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae20759e-0e4f-4e29-8897-7eb813e03b32" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.755772] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae20759e-0e4f-4e29-8897-7eb813e03b32" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.755772] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.755772] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.755772] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.755772] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.755772] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.755772] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae20759e-0e4f-4e29-8897-7eb813e03b32" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.755772] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ae20759e-0e4f-4e29-8897-7eb813e03b32',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.944918] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47118de8-4ba9-49a6-bc4b-d030be1e7c79 in Status: SUCCESS [ 929.945469] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.129066] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.129066] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.129702] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.129702] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.129702] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.129852] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port a16be442-33e0-4e8b-9e6b-0c1bb5d2e402 not found, creating... [ 930.130282] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.130282] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.130622] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.131158] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.131158] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.131344] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.131545] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.131727] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.131975] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.132146] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.132298] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: a16be442-33e0-4e8b-9e6b-0c1bb5d2e402 is going to be created. [ 930.138328] env[62842]: INFO networking_nsxv3.common.synchronization [req-5572ebb6-cbea-44d2-8abd-f89e2a0bf747 req-e2a9acc7-69b2-4c6d-b03d-256648a0506c tempest-ServersAdminNegativeTestJSON-1401896846 tempest-ServersAdminNegativeTestJSON-1401896846-project-member] Enqueued Resource ID: b47c6fcc-dd2d-4dd3-979a-610c0739cfd0 with Priority: HIGHEST for action security_group_members [ 930.139548] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b47c6fcc-dd2d-4dd3-979a-610c0739cfd0 with Priority: HIGHEST for action security_group_members [ 930.140595] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.141638] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.141638] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.141638] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.142221] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.142221] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.142221] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.142221] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.142510] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.142510] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b47c6fcc-dd2d-4dd3-979a-610c0739cfd0',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.205969] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.206290] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.206425] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.207232] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.207232] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.209332] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-a16be442-33e0-4e8b-9e6b-0c1bb5d2e402" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.258031] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ae20759e-0e4f-4e29-8897-7eb813e03b32',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.645347] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b47c6fcc-dd2d-4dd3-979a-610c0739cfd0',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.760423] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ae20759e-0e4f-4e29-8897-7eb813e03b32: rpc.has_security_group_logging(os_id): False [ 930.785685] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.788854] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.788854] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.789059] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.789163] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.789440] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.789542] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.789608] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.789775] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.789853] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.789942] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae20759e-0e4f-4e29-8897-7eb813e03b32 is going to be created. [ 930.867305] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.867516] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.867594] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.868056] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.868163] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.885282] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae20759e-0e4f-4e29-8897-7eb813e03b32 in Status: IN_PROGRESS for 2s [ 930.991738] env[62842]: INFO networking_nsxv3.common.synchronization [req-6b554e81-3d00-4871-b2c1-3a387ace292f req-dfff4370-8f09-46e8-ac19-2d1a638a763c service nova] Enqueued Resource ID: 217e8514-093a-4d74-b378-a5091c69f5ba with Priority: HIGHEST for action security_group_rules [ 930.991738] env[62842]: INFO networking_nsxv3.common.synchronization [req-6b554e81-3d00-4871-b2c1-3a387ace292f req-dfff4370-8f09-46e8-ac19-2d1a638a763c service nova] Enqueued Resource ID: 217e8514-093a-4d74-b378-a5091c69f5ba with Priority: HIGHEST for action security_group_members [ 930.991885] env[62842]: INFO networking_nsxv3.common.synchronization [req-6b554e81-3d00-4871-b2c1-3a387ace292f req-dfff4370-8f09-46e8-ac19-2d1a638a763c service nova] Enqueued Resource ID: a16be442-33e0-4e8b-9e6b-0c1bb5d2e402 with Priority: HIGHEST for action port [ 930.992958] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 217e8514-093a-4d74-b378-a5091c69f5ba with Priority: HIGHEST for action security_group_rules [ 930.992958] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 217e8514-093a-4d74-b378-a5091c69f5ba with Priority: HIGHEST for action security_group_members [ 930.992958] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a16be442-33e0-4e8b-9e6b-0c1bb5d2e402 with Priority: HIGHEST for action port [ 930.994104] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-217e8514-093a-4d74-b378-a5091c69f5ba taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.994269] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-217e8514-093a-4d74-b378-a5091c69f5ba" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.994335] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-217e8514-093a-4d74-b378-a5091c69f5ba" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.994631] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-217e8514-093a-4d74-b378-a5091c69f5ba" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.994719] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('217e8514-093a-4d74-b378-a5091c69f5ba',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.996630] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-217e8514-093a-4d74-b378-a5091c69f5ba taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.996763] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-217e8514-093a-4d74-b378-a5091c69f5ba" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.996820] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-217e8514-093a-4d74-b378-a5091c69f5ba" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.997030] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-217e8514-093a-4d74-b378-a5091c69f5ba" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.997214] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.997310] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.997367] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.997556] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.997631] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.997732] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('217e8514-093a-4d74-b378-a5091c69f5ba',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.000059] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-a16be442-33e0-4e8b-9e6b-0c1bb5d2e402 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.000059] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a16be442-33e0-4e8b-9e6b-0c1bb5d2e402" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.000059] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a16be442-33e0-4e8b-9e6b-0c1bb5d2e402" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.000059] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a16be442-33e0-4e8b-9e6b-0c1bb5d2e402" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.000059] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a16be442-33e0-4e8b-9e6b-0c1bb5d2e402',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.149706] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b47c6fcc-dd2d-4dd3-979a-610c0739cfd0',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.497589] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-217e8514-093a-4d74-b378-a5091c69f5ba taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.497589] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-217e8514-093a-4d74-b378-a5091c69f5ba" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.502254] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('217e8514-093a-4d74-b378-a5091c69f5ba',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.502755] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a16be442-33e0-4e8b-9e6b-0c1bb5d2e402 with status ACTIVE [ 931.503052] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.503253] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.503342] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.505703] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.505703] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.505703] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.505703] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.505703] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.505703] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.505703] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.505703] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.505703] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.505703] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.505703] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.505703] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.505703] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a16be442-33e0-4e8b-9e6b-0c1bb5d2e402 is going to be updated. [ 931.529534] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.529712] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.529801] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.530085] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.530377] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.530749] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a16be442-33e0-4e8b-9e6b-0c1bb5d2e402" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.653030] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.653765] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.653765] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.654293] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.654293] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.654293] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b47c6fcc-dd2d-4dd3-979a-610c0739cfd0 is going to be updated. [ 931.717420] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.717583] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.717724] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.717929] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.718141] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.738766] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b47c6fcc-dd2d-4dd3-979a-610c0739cfd0 in Status: IN_PROGRESS for 2s [ 932.003426] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('217e8514-093a-4d74-b378-a5091c69f5ba',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.507429] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.507754] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.507754] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.508059] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.508150] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.508275] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 217e8514-093a-4d74-b378-a5091c69f5ba is going to be created. [ 932.535560] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.535741] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.535841] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.536125] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.536328] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.547779] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 217e8514-093a-4d74-b378-a5091c69f5ba in Status: UNINITIALIZED for 2s [ 932.564696] env[62842]: INFO networking_nsxv3.common.synchronization [req-f9908e4b-77ac-4c5a-bfa5-25cde16dd2be req-086e3225-d298-429d-bd8a-134ffaaf8bfb tempest-ServerActionsTestOtherA-1611322165 tempest-ServerActionsTestOtherA-1611322165-project-member] Enqueued Resource ID: 102e4bfe-92ec-41e7-859f-253e7a405698 with Priority: HIGHEST for action security_group_members [ 932.566047] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 102e4bfe-92ec-41e7-859f-253e7a405698 with Priority: HIGHEST for action security_group_members [ 932.566047] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-102e4bfe-92ec-41e7-859f-253e7a405698 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.566047] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-102e4bfe-92ec-41e7-859f-253e7a405698" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.566250] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-102e4bfe-92ec-41e7-859f-253e7a405698" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.566282] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-102e4bfe-92ec-41e7-859f-253e7a405698" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.566601] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.566707] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.566809] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.567071] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.567212] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.567395] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('102e4bfe-92ec-41e7-859f-253e7a405698',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.899885] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae20759e-0e4f-4e29-8897-7eb813e03b32 in Status: SUCCESS [ 932.900179] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae20759e-0e4f-4e29-8897-7eb813e03b32" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.070822] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.071083] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.071150] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.071361] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.071454] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.071683] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.071817] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.071950] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.072161] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.072290] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.072407] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 102e4bfe-92ec-41e7-859f-253e7a405698 is going to be updated. [ 933.100688] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.100916] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.100973] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.101184] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.101326] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.111871] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 102e4bfe-92ec-41e7-859f-253e7a405698 in Status: IN_PROGRESS for 2s [ 933.753865] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b47c6fcc-dd2d-4dd3-979a-610c0739cfd0 in Status: SUCCESS [ 933.753865] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.154860] env[62842]: INFO networking_nsxv3.common.synchronization [req-acfc690c-49b5-436d-8d34-e3d643bceb33 req-9375ebb4-8e89-4811-b4c2-df531a0f0d08 tempest-AttachVolumeNegativeTest-1420230652 tempest-AttachVolumeNegativeTest-1420230652-project-member] Enqueued Resource ID: 6588f3bb-b208-4ec7-8a50-1e573d683f24 with Priority: HIGHEST for action security_group_members [ 934.157658] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6588f3bb-b208-4ec7-8a50-1e573d683f24 with Priority: HIGHEST for action security_group_members [ 934.157996] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-6588f3bb-b208-4ec7-8a50-1e573d683f24 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.158799] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6588f3bb-b208-4ec7-8a50-1e573d683f24" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.158876] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6588f3bb-b208-4ec7-8a50-1e573d683f24" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.159094] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6588f3bb-b208-4ec7-8a50-1e573d683f24" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.159283] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.159366] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.159437] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.159590] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.159678] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.159776] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6588f3bb-b208-4ec7-8a50-1e573d683f24',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.560048] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 217e8514-093a-4d74-b378-a5091c69f5ba in Status: SUCCESS [ 934.560048] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-217e8514-093a-4d74-b378-a5091c69f5ba" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.560048] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-217e8514-093a-4d74-b378-a5091c69f5ba" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.560048] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-217e8514-093a-4d74-b378-a5091c69f5ba" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.560048] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.560048] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.560048] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.560048] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.560048] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.560048] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-217e8514-093a-4d74-b378-a5091c69f5ba" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.560048] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('217e8514-093a-4d74-b378-a5091c69f5ba',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.664565] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.664565] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.664565] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.664565] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.664565] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.664565] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.664565] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.664565] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.664565] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.664565] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.664565] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6588f3bb-b208-4ec7-8a50-1e573d683f24 is going to be updated. [ 934.693502] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.693502] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.693502] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.693502] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.693502] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.701566] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6588f3bb-b208-4ec7-8a50-1e573d683f24 in Status: IN_PROGRESS for 2s [ 935.061993] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-217e8514-093a-4d74-b378-a5091c69f5ba taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.062465] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-217e8514-093a-4d74-b378-a5091c69f5ba" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.062465] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-217e8514-093a-4d74-b378-a5091c69f5ba" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.062874] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-217e8514-093a-4d74-b378-a5091c69f5ba" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.063252] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.063398] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.063487] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.063691] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.063832] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.063982] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-217e8514-093a-4d74-b378-a5091c69f5ba" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.064235] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-217e8514-093a-4d74-b378-a5091c69f5ba taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.064400] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-217e8514-093a-4d74-b378-a5091c69f5ba" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.064512] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-217e8514-093a-4d74-b378-a5091c69f5ba" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.065798] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-217e8514-093a-4d74-b378-a5091c69f5ba" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.066651] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.066961] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.066961] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.067162] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.067378] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.067445] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-217e8514-093a-4d74-b378-a5091c69f5ba" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.067522] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('217e8514-093a-4d74-b378-a5091c69f5ba',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.125675] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 102e4bfe-92ec-41e7-859f-253e7a405698 in Status: SUCCESS [ 935.125881] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 102e4bfe-92ec-41e7-859f-253e7a405698 deletion is rescheduled due to dependency. [ 935.125998] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-102e4bfe-92ec-41e7-859f-253e7a405698" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.570317] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 217e8514-093a-4d74-b378-a5091c69f5ba: rpc.has_security_group_logging(os_id): False [ 935.589982] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.590147] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.590220] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.590431] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.590525] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.590856] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.591216] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.591216] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.591305] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.591354] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.591523] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.591618] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.591778] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.591933] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.592022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.592215] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.592311] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.592373] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.592512] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.592587] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.592672] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 217e8514-093a-4d74-b378-a5091c69f5ba is going to be created. [ 935.661351] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.661548] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.661803] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.661935] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.663032] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.675446] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 217e8514-093a-4d74-b378-a5091c69f5ba in Status: IN_PROGRESS for 2s [ 936.713898] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6588f3bb-b208-4ec7-8a50-1e573d683f24 in Status: IN_PROGRESS for 4s [ 937.689045] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 217e8514-093a-4d74-b378-a5091c69f5ba in Status: SUCCESS [ 937.689277] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-217e8514-093a-4d74-b378-a5091c69f5ba" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.728889] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6588f3bb-b208-4ec7-8a50-1e573d683f24 in Status: SUCCESS [ 938.729298] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6588f3bb-b208-4ec7-8a50-1e573d683f24 deletion is rescheduled due to dependency. [ 938.729298] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6588f3bb-b208-4ec7-8a50-1e573d683f24" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.160079] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 939.160079] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 940.252042] env[62842]: INFO networking_nsxv3.common.synchronization [req-9e16a249-1a10-4b87-934a-6e064fc29867 req-2099ce39-0ec8-4fda-b5b6-8de1b14dbd1c tempest-ServerMetadataNegativeTestJSON-162207829 tempest-ServerMetadataNegativeTestJSON-162207829-project-member] Enqueued Resource ID: 1ecbdf52-553d-43c4-b969-597ffc82c5d6 with Priority: HIGHEST for action security_group_members [ 940.252042] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ecbdf52-553d-43c4-b969-597ffc82c5d6 with Priority: HIGHEST for action security_group_members [ 940.252042] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ecbdf52-553d-43c4-b969-597ffc82c5d6 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.252042] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ecbdf52-553d-43c4-b969-597ffc82c5d6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.252042] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ecbdf52-553d-43c4-b969-597ffc82c5d6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.252042] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ecbdf52-553d-43c4-b969-597ffc82c5d6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.253129] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.253439] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.253650] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.253962] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.254201] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.254485] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ecbdf52-553d-43c4-b969-597ffc82c5d6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.761399] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.761628] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.761742] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.762415] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.762415] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.762490] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.762639] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.762736] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.762963] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.763115] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.763252] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ecbdf52-553d-43c4-b969-597ffc82c5d6 already deleted. [ 940.763383] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ecbdf52-553d-43c4-b969-597ffc82c5d6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.867171] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-500 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.867391] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-500" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.867510] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-500" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.868321] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-500" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.868423] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.868603] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.868792] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.869264] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.869588] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.870418] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 940.870418] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 940.870556] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 940.870650] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 940.870744] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 940.870907] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 940.871106] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 940.898980] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 940.899173] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 940.899318] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 940.900198] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-500" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.900198] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-ebaedf75-f580-4017-9d62-b0fe837a8d0d taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.900198] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-ebaedf75-f580-4017-9d62-b0fe837a8d0d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.900198] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-ebaedf75-f580-4017-9d62-b0fe837a8d0d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.900504] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-ebaedf75-f580-4017-9d62-b0fe837a8d0d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.901559] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ebaedf75-f580-4017-9d62-b0fe837a8d0d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.403853] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.404827] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.407027] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.407027] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.407027] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.407027] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port ebaedf75-f580-4017-9d62-b0fe837a8d0d not found, creating... [ 941.407027] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.407027] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.407027] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.407027] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.407902] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.408990] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.412077] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.412077] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.412077] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.412077] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.412077] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: ebaedf75-f580-4017-9d62-b0fe837a8d0d is going to be created. [ 941.439259] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.439691] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.440190] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.443978] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.444171] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.444527] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-ebaedf75-f580-4017-9d62-b0fe837a8d0d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.804150] env[62842]: INFO networking_nsxv3.common.synchronization [req-48ab8af8-20b9-4900-b680-6e929be8a4d0 req-51655768-29e7-4845-8195-2497182f7af9 tempest-FloatingIPsAssociationTestJSON-1346363058 tempest-FloatingIPsAssociationTestJSON-1346363058-project-member] Enqueued Resource ID: 47118de8-4ba9-49a6-bc4b-d030be1e7c79 with Priority: HIGHEST for action security_group_members [ 941.804613] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47118de8-4ba9-49a6-bc4b-d030be1e7c79 with Priority: HIGHEST for action security_group_members [ 941.806529] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-47118de8-4ba9-49a6-bc4b-d030be1e7c79 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.806730] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.806861] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.807567] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.807567] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.807567] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.807567] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.807748] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.807802] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.807908] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47118de8-4ba9-49a6-bc4b-d030be1e7c79',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.310639] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('47118de8-4ba9-49a6-bc4b-d030be1e7c79',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.717460] env[62842]: INFO networking_nsxv3.common.synchronization [req-9e16a249-1a10-4b87-934a-6e064fc29867 req-eeaf62c9-eb8f-472e-b6d6-76fc2d4fd166 service nova] Enqueued Resource ID: 1ecbdf52-553d-43c4-b969-597ffc82c5d6 with Priority: HIGHEST for action security_group_rules [ 942.717740] env[62842]: INFO networking_nsxv3.common.synchronization [req-9e16a249-1a10-4b87-934a-6e064fc29867 req-eeaf62c9-eb8f-472e-b6d6-76fc2d4fd166 service nova] Enqueued Resource ID: 1ecbdf52-553d-43c4-b969-597ffc82c5d6 with Priority: HIGHEST for action security_group_members [ 942.717793] env[62842]: INFO networking_nsxv3.common.synchronization [req-9e16a249-1a10-4b87-934a-6e064fc29867 req-eeaf62c9-eb8f-472e-b6d6-76fc2d4fd166 service nova] Enqueued Resource ID: ebaedf75-f580-4017-9d62-b0fe837a8d0d with Priority: HIGHEST for action port [ 942.719895] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ecbdf52-553d-43c4-b969-597ffc82c5d6 with Priority: HIGHEST for action security_group_rules [ 942.719895] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ecbdf52-553d-43c4-b969-597ffc82c5d6 with Priority: HIGHEST for action security_group_members [ 942.719895] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebaedf75-f580-4017-9d62-b0fe837a8d0d with Priority: HIGHEST for action port [ 942.719895] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ecbdf52-553d-43c4-b969-597ffc82c5d6 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.719895] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ecbdf52-553d-43c4-b969-597ffc82c5d6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.719895] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ecbdf52-553d-43c4-b969-597ffc82c5d6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.720340] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ecbdf52-553d-43c4-b969-597ffc82c5d6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.720340] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ecbdf52-553d-43c4-b969-597ffc82c5d6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.721263] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ecbdf52-553d-43c4-b969-597ffc82c5d6 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.721422] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ecbdf52-553d-43c4-b969-597ffc82c5d6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.721512] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ecbdf52-553d-43c4-b969-597ffc82c5d6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.721724] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ecbdf52-553d-43c4-b969-597ffc82c5d6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.722918] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.723102] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.723280] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.723848] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.723974] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.724123] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ecbdf52-553d-43c4-b969-597ffc82c5d6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.726536] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-ebaedf75-f580-4017-9d62-b0fe837a8d0d taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.726536] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ebaedf75-f580-4017-9d62-b0fe837a8d0d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.726536] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ebaedf75-f580-4017-9d62-b0fe837a8d0d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.726536] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ebaedf75-f580-4017-9d62-b0fe837a8d0d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.726536] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ebaedf75-f580-4017-9d62-b0fe837a8d0d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.747573] env[62842]: INFO networking_nsxv3.common.synchronization [req-cc830f3b-19d5-484b-ba51-7b907d2deaa2 req-6dcd4fe6-3428-4c4b-a1b9-c6e39633b559 tempest-ServerRescueNegativeTestJSON-1880350091 tempest-ServerRescueNegativeTestJSON-1880350091-project-member] Enqueued Resource ID: ea061614-3b2c-4a61-a74b-32a4b42f10a1 with Priority: HIGHEST for action security_group_members [ 942.748158] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea061614-3b2c-4a61-a74b-32a4b42f10a1 with Priority: HIGHEST for action security_group_members [ 942.748508] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea061614-3b2c-4a61-a74b-32a4b42f10a1 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.748724] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.748776] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.749179] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.749365] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.749521] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.749615] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.749892] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.750040] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.750192] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea061614-3b2c-4a61-a74b-32a4b42f10a1',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.812699] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('47118de8-4ba9-49a6-bc4b-d030be1e7c79',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.106119] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-243 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.106340] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-243" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.106668] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-243" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.106980] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-243" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.107321] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.107573] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.107725] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.107975] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.108146] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.108354] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 943.108701] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 943.108888] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 943.109133] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 943.109320] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 943.109466] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 943.109634] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 943.128856] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 943.129054] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 943.129205] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 943.129378] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-243" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.129693] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-82100ae2-289f-494e-b6b5-67aac77553d1 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.129863] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-82100ae2-289f-494e-b6b5-67aac77553d1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.129981] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-82100ae2-289f-494e-b6b5-67aac77553d1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.130339] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-82100ae2-289f-494e-b6b5-67aac77553d1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.130480] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82100ae2-289f-494e-b6b5-67aac77553d1',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.228321] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ecbdf52-553d-43c4-b969-597ffc82c5d6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.230574] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ecbdf52-553d-43c4-b969-597ffc82c5d6 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.230904] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ecbdf52-553d-43c4-b969-597ffc82c5d6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.231739] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ebaedf75-f580-4017-9d62-b0fe837a8d0d with status ACTIVE [ 943.232070] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.238784] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.238784] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.238784] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.238784] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.238784] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.238784] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.238784] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.238784] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.238784] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.238784] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.238784] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.238784] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.238784] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.238784] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.238784] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ebaedf75-f580-4017-9d62-b0fe837a8d0d is going to be updated. [ 943.255113] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.255113] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.255113] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.255113] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.255113] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.255113] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.255113] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.255113] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.255113] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.255113] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.255113] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea061614-3b2c-4a61-a74b-32a4b42f10a1 already deleted. [ 943.255113] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.259668] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.259824] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.259867] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.260030] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.260169] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.260316] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ebaedf75-f580-4017-9d62-b0fe837a8d0d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.315121] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.315121] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.315350] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.315385] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.315465] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.315568] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47118de8-4ba9-49a6-bc4b-d030be1e7c79 is going to be updated. [ 943.355423] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.355648] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.355648] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.355919] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.355919] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.371615] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47118de8-4ba9-49a6-bc4b-d030be1e7c79 in Status: IN_PROGRESS for 2s [ 943.633081] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.633319] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.633449] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.633740] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.633900] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.634088] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 82100ae2-289f-494e-b6b5-67aac77553d1 not found, creating... [ 943.634397] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.634561] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.634699] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.634921] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.635081] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.635374] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.635534] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.635655] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.635940] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.636015] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.636171] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 82100ae2-289f-494e-b6b5-67aac77553d1 is going to be created. [ 943.657060] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.657381] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.657539] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.657811] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.658059] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.658296] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-82100ae2-289f-494e-b6b5-67aac77553d1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.739893] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ecbdf52-553d-43c4-b969-597ffc82c5d6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.242088] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.242277] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.242352] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.242566] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.242657] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.242761] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ecbdf52-553d-43c4-b969-597ffc82c5d6 is going to be created. [ 944.274246] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.274469] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.274469] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.274947] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.274947] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.286337] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ecbdf52-553d-43c4-b969-597ffc82c5d6 in Status: UNINITIALIZED for 2s [ 944.356023] env[62842]: INFO networking_nsxv3.common.synchronization [req-cc830f3b-19d5-484b-ba51-7b907d2deaa2 req-c3b4f899-44cf-4e0e-b290-83c5fad1f14b service nova] Enqueued Resource ID: ea061614-3b2c-4a61-a74b-32a4b42f10a1 with Priority: HIGHEST for action security_group_rules [ 944.356023] env[62842]: INFO networking_nsxv3.common.synchronization [req-cc830f3b-19d5-484b-ba51-7b907d2deaa2 req-c3b4f899-44cf-4e0e-b290-83c5fad1f14b service nova] Enqueued Resource ID: ea061614-3b2c-4a61-a74b-32a4b42f10a1 with Priority: HIGHEST for action security_group_members [ 944.356023] env[62842]: INFO networking_nsxv3.common.synchronization [req-cc830f3b-19d5-484b-ba51-7b907d2deaa2 req-c3b4f899-44cf-4e0e-b290-83c5fad1f14b service nova] Enqueued Resource ID: 82100ae2-289f-494e-b6b5-67aac77553d1 with Priority: HIGHEST for action port [ 944.356023] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea061614-3b2c-4a61-a74b-32a4b42f10a1 with Priority: HIGHEST for action security_group_rules [ 944.356023] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea061614-3b2c-4a61-a74b-32a4b42f10a1 with Priority: HIGHEST for action security_group_members [ 944.356023] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82100ae2-289f-494e-b6b5-67aac77553d1 with Priority: HIGHEST for action port [ 944.356023] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ea061614-3b2c-4a61-a74b-32a4b42f10a1 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.356023] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.356023] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.356830] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.357126] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ea061614-3b2c-4a61-a74b-32a4b42f10a1',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.358747] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea061614-3b2c-4a61-a74b-32a4b42f10a1 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.359132] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.359312] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.359735] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.360275] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.361138] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.361138] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.361138] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.364892] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.364892] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea061614-3b2c-4a61-a74b-32a4b42f10a1',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.364892] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-82100ae2-289f-494e-b6b5-67aac77553d1 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.364892] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82100ae2-289f-494e-b6b5-67aac77553d1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.364892] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82100ae2-289f-494e-b6b5-67aac77553d1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.364892] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82100ae2-289f-494e-b6b5-67aac77553d1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.364892] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82100ae2-289f-494e-b6b5-67aac77553d1',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.866244] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea061614-3b2c-4a61-a74b-32a4b42f10a1 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.866548] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.872036] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 82100ae2-289f-494e-b6b5-67aac77553d1 with status ACTIVE [ 944.872036] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.872036] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.872036] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.872036] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.872036] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.872036] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.872036] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.872036] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.872036] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.872036] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.872036] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.872036] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.872036] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.872036] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.872036] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.872036] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 82100ae2-289f-494e-b6b5-67aac77553d1 is going to be updated. [ 944.873061] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ea061614-3b2c-4a61-a74b-32a4b42f10a1',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.900548] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.900548] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.900548] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.900548] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.900548] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.900548] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82100ae2-289f-494e-b6b5-67aac77553d1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.316796] env[62842]: INFO networking_nsxv3.common.synchronization [req-ae639b5e-0dc9-44a8-91a9-43da04a3e0ef req-1740e278-9b03-42bd-848b-b1978554d270 tempest-ServersTestMultiNic-2049983028 tempest-ServersTestMultiNic-2049983028-project-member] Enqueued Resource ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 with Priority: HIGHEST for action security_group_members [ 945.317356] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 with Priority: HIGHEST for action security_group_members [ 945.317670] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e90c0f27-4513-40eb-ba31-bf40f699d9a6 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.317780] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.318258] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.318483] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.318650] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.318772] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.318844] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.320846] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.320846] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.320846] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e90c0f27-4513-40eb-ba31-bf40f699d9a6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.375586] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ea061614-3b2c-4a61-a74b-32a4b42f10a1',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.385397] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47118de8-4ba9-49a6-bc4b-d030be1e7c79 in Status: SUCCESS [ 945.385397] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.583426] env[62842]: INFO networking_nsxv3.common.synchronization [req-c7d75a3f-c1e2-436c-9041-cf7ab03591a7 req-756f26b0-4068-4e64-968d-31727cfb8f8c tempest-ServerAddressesTestJSON-844044825 tempest-ServerAddressesTestJSON-844044825-project-member] Enqueued Resource ID: 217e8514-093a-4d74-b378-a5091c69f5ba with Priority: HIGHEST for action security_group_members [ 945.585087] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 217e8514-093a-4d74-b378-a5091c69f5ba with Priority: HIGHEST for action security_group_members [ 945.585087] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-217e8514-093a-4d74-b378-a5091c69f5ba taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.585087] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-217e8514-093a-4d74-b378-a5091c69f5ba" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.585087] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-217e8514-093a-4d74-b378-a5091c69f5ba" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.585087] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-217e8514-093a-4d74-b378-a5091c69f5ba" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.585087] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.585087] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.585087] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.585087] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.585087] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.585820] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('217e8514-093a-4d74-b378-a5091c69f5ba',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.822185] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.822430] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.822430] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.822607] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.822689] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.822884] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.823049] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.823049] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.823217] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.823290] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.823372] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 is going to be updated. [ 945.856921] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.857096] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.857168] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.857375] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.857515] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.867252] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 in Status: IN_PROGRESS for 2s [ 945.877806] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.877939] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.878017] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.878232] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.878316] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.878410] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea061614-3b2c-4a61-a74b-32a4b42f10a1 is going to be created. [ 945.906975] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.907160] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.907228] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.907435] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.907584] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.917725] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea061614-3b2c-4a61-a74b-32a4b42f10a1 in Status: UNINITIALIZED for 2s [ 945.923927] env[62842]: INFO networking_nsxv3.common.synchronization [req-ae639b5e-0dc9-44a8-91a9-43da04a3e0ef req-1dedc948-047e-4501-a4d3-79f4de5e8d88 tempest-ServersTestMultiNic-2049983028 tempest-ServersTestMultiNic-2049983028-project-member] Enqueued Resource ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 with Priority: HIGHEST for action security_group_members [ 945.924410] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 with Priority: HIGHEST for action security_group_members [ 945.925065] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e90c0f27-4513-40eb-ba31-bf40f699d9a6 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.925174] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.089379] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.089379] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.089379] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.089379] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.089379] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.089379] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.089379] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.089379] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.089379] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.089379] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.089379] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 217e8514-093a-4d74-b378-a5091c69f5ba is going to be updated. [ 946.117024] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.117024] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.117024] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.117024] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.117024] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.125199] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 217e8514-093a-4d74-b378-a5091c69f5ba in Status: IN_PROGRESS for 2s [ 946.234166] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-969 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.234166] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-969" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.234166] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-969" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.234166] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-969" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.234166] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.234997] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.235285] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.235629] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.235949] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.236416] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 946.236750] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 946.239017] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 946.239017] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 946.239017] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 946.239017] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 946.239017] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 946.273511] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 946.273757] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 946.273829] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 946.274028] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-969" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.274359] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-51935ef8-377e-442e-9927-cd8fe889663e taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.274529] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-51935ef8-377e-442e-9927-cd8fe889663e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.274679] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-51935ef8-377e-442e-9927-cd8fe889663e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.275202] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-51935ef8-377e-442e-9927-cd8fe889663e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.275202] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51935ef8-377e-442e-9927-cd8fe889663e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.297449] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ecbdf52-553d-43c4-b969-597ffc82c5d6 in Status: SUCCESS [ 946.297615] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ecbdf52-553d-43c4-b969-597ffc82c5d6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.297777] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ecbdf52-553d-43c4-b969-597ffc82c5d6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.297998] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ecbdf52-553d-43c4-b969-597ffc82c5d6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.298200] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.298355] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.298395] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.298518] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.298598] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.298682] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ecbdf52-553d-43c4-b969-597ffc82c5d6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.298772] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ecbdf52-553d-43c4-b969-597ffc82c5d6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.779099] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.779099] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.779099] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.779448] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.779655] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.779868] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 51935ef8-377e-442e-9927-cd8fe889663e not found, creating... [ 946.781050] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.781050] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.781050] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.781050] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.781312] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.781574] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.781799] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.781942] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.782173] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.782464] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.782464] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 51935ef8-377e-442e-9927-cd8fe889663e is going to be created. [ 946.801784] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ecbdf52-553d-43c4-b969-597ffc82c5d6 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.802013] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ecbdf52-553d-43c4-b969-597ffc82c5d6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.802133] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ecbdf52-553d-43c4-b969-597ffc82c5d6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.802410] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ecbdf52-553d-43c4-b969-597ffc82c5d6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.802642] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.802770] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.802850] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.803060] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.803169] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.803303] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ecbdf52-553d-43c4-b969-597ffc82c5d6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.803456] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ecbdf52-553d-43c4-b969-597ffc82c5d6 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.803564] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ecbdf52-553d-43c4-b969-597ffc82c5d6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.803631] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ecbdf52-553d-43c4-b969-597ffc82c5d6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.803807] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ecbdf52-553d-43c4-b969-597ffc82c5d6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.803977] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.804102] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.804197] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.804369] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.804513] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.804628] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ecbdf52-553d-43c4-b969-597ffc82c5d6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.804792] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ecbdf52-553d-43c4-b969-597ffc82c5d6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.819587] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.819866] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.819958] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.820286] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.820609] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.820890] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-51935ef8-377e-442e-9927-cd8fe889663e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.308493] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ecbdf52-553d-43c4-b969-597ffc82c5d6: rpc.has_security_group_logging(os_id): False [ 947.330258] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.330419] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.330480] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.330795] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.330871] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.331070] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.331153] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.331201] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.331355] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.331431] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.331612] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.331703] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.331764] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.331930] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.331993] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.332231] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.332323] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.332381] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.332519] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.332591] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.332674] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ecbdf52-553d-43c4-b969-597ffc82c5d6 is going to be created. [ 947.410920] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.411089] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.411177] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.411392] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.411620] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.425149] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ecbdf52-553d-43c4-b969-597ffc82c5d6 in Status: IN_PROGRESS for 2s [ 947.458581] env[62842]: INFO networking_nsxv3.common.synchronization [req-56d3af38-65d2-46ec-b8ee-fc1f04d54f3e req-7b7d566e-d20b-427b-b3cf-0e7993d108e9 tempest-ServerRescueNegativeTestJSON-1880350091 tempest-ServerRescueNegativeTestJSON-1880350091-project-member] Enqueued Resource ID: ea061614-3b2c-4a61-a74b-32a4b42f10a1 with Priority: HIGHEST for action security_group_members [ 947.459206] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea061614-3b2c-4a61-a74b-32a4b42f10a1 with Priority: HIGHEST for action security_group_members [ 947.459582] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea061614-3b2c-4a61-a74b-32a4b42f10a1 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.459653] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.775877] env[62842]: INFO networking_nsxv3.common.synchronization [req-ae639b5e-0dc9-44a8-91a9-43da04a3e0ef req-9673f6eb-f079-4da0-82fc-77c68007290d service nova] Enqueued Resource ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 with Priority: HIGHEST for action security_group_rules [ 947.775877] env[62842]: INFO networking_nsxv3.common.synchronization [req-ae639b5e-0dc9-44a8-91a9-43da04a3e0ef req-9673f6eb-f079-4da0-82fc-77c68007290d service nova] Enqueued Resource ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 with Priority: HIGHEST for action security_group_members [ 947.775877] env[62842]: INFO networking_nsxv3.common.synchronization [req-ae639b5e-0dc9-44a8-91a9-43da04a3e0ef req-9673f6eb-f079-4da0-82fc-77c68007290d service nova] Enqueued Resource ID: 51935ef8-377e-442e-9927-cd8fe889663e with Priority: HIGHEST for action port [ 947.775877] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 with Priority: HIGHEST for action security_group_rules [ 947.775877] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 with Priority: HIGHEST for action security_group_members [ 947.776692] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51935ef8-377e-442e-9927-cd8fe889663e with Priority: HIGHEST for action port [ 947.776692] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e90c0f27-4513-40eb-ba31-bf40f699d9a6 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.776692] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.776855] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.777342] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.777342] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e90c0f27-4513-40eb-ba31-bf40f699d9a6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.778190] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e90c0f27-4513-40eb-ba31-bf40f699d9a6 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.778485] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.778485] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-51935ef8-377e-442e-9927-cd8fe889663e taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.778638] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-51935ef8-377e-442e-9927-cd8fe889663e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.778687] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-51935ef8-377e-442e-9927-cd8fe889663e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.779520] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-51935ef8-377e-442e-9927-cd8fe889663e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.779520] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51935ef8-377e-442e-9927-cd8fe889663e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.878514] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 in Status: SUCCESS [ 947.880940] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 deletion is rescheduled due to dependency. [ 947.880940] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.881310] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.881595] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.881804] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.881924] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.881990] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.882221] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.882323] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.882435] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e90c0f27-4513-40eb-ba31-bf40f699d9a6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.929410] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea061614-3b2c-4a61-a74b-32a4b42f10a1 in Status: SUCCESS [ 947.929663] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.929829] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.930045] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.930238] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.930351] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.930415] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.930561] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.930643] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.930727] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.930995] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ea061614-3b2c-4a61-a74b-32a4b42f10a1',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.931907] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.932288] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.932531] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.932746] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.932833] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.933038] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.933161] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.933286] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea061614-3b2c-4a61-a74b-32a4b42f10a1',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.947947] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-243 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.947947] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-243" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.947947] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-243" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.947947] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-243" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.947947] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.947947] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.948503] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.948503] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.948503] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.948606] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 947.949230] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 947.949337] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 947.949431] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 947.949578] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 947.949750] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 947.949924] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 947.970627] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 947.970883] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 947.971058] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 947.971245] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-243" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.971574] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-002b2eb1-90e1-49a2-b9b5-ddeb7728ab4e taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.971776] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-002b2eb1-90e1-49a2-b9b5-ddeb7728ab4e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.971902] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-002b2eb1-90e1-49a2-b9b5-ddeb7728ab4e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.972280] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-002b2eb1-90e1-49a2-b9b5-ddeb7728ab4e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.972439] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('002b2eb1-90e1-49a2-b9b5-ddeb7728ab4e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.134523] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 217e8514-093a-4d74-b378-a5091c69f5ba in Status: SUCCESS [ 948.134714] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 217e8514-093a-4d74-b378-a5091c69f5ba deletion is rescheduled due to dependency. [ 948.134837] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-217e8514-093a-4d74-b378-a5091c69f5ba" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.282162] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e90c0f27-4513-40eb-ba31-bf40f699d9a6 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.282256] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.282412] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 51935ef8-377e-442e-9927-cd8fe889663e with status ACTIVE [ 948.282581] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.282685] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.282746] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.282956] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.283084] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.283259] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.283358] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.283419] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.283568] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.283645] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.283825] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.283938] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.284009] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.284155] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.284228] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.284312] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 51935ef8-377e-442e-9927-cd8fe889663e is going to be updated. [ 948.307636] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.308629] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.308629] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.308629] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.308629] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.309055] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-51935ef8-377e-442e-9927-cd8fe889663e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.384599] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e90c0f27-4513-40eb-ba31-bf40f699d9a6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.437249] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea061614-3b2c-4a61-a74b-32a4b42f10a1 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.437481] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.437532] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ea061614-3b2c-4a61-a74b-32a4b42f10a1',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.474645] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.474895] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.475057] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.475452] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.475630] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.475807] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 002b2eb1-90e1-49a2-b9b5-ddeb7728ab4e not found, creating... [ 948.476224] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.476418] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.476615] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.476857] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.476942] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.477275] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.477445] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.477565] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.477779] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.477920] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.478089] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 002b2eb1-90e1-49a2-b9b5-ddeb7728ab4e is going to be created. [ 948.504435] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.504788] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.504788] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.505263] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.506445] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.506813] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-002b2eb1-90e1-49a2-b9b5-ddeb7728ab4e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.612021] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-914 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.612021] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-914" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.612021] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-914" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.612021] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-914" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.612021] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.612021] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.612021] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.612021] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.612450] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.612450] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 948.612510] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 948.612620] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 948.612724] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 948.612834] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 948.612943] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 948.613110] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 948.644573] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 948.644748] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 948.644933] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 948.645221] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-914" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.645691] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-8b114873-0408-422e-8fd1-c66c3bc608c2 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.645896] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-8b114873-0408-422e-8fd1-c66c3bc608c2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.646036] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-8b114873-0408-422e-8fd1-c66c3bc608c2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.646707] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-8b114873-0408-422e-8fd1-c66c3bc608c2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.646707] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b114873-0408-422e-8fd1-c66c3bc608c2',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.887531] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e90c0f27-4513-40eb-ba31-bf40f699d9a6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.940103] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ea061614-3b2c-4a61-a74b-32a4b42f10a1',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.148891] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.149215] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.149370] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.149708] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.149901] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.150125] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 8b114873-0408-422e-8fd1-c66c3bc608c2 not found, creating... [ 949.150447] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.150646] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.150806] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.151061] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.151211] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.151524] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.151701] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.151823] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.152063] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.152196] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.152343] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 8b114873-0408-422e-8fd1-c66c3bc608c2 is going to be created. [ 949.178346] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.178576] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.178713] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.179043] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.179290] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.179519] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-8b114873-0408-422e-8fd1-c66c3bc608c2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.320068] env[62842]: INFO networking_nsxv3.common.synchronization [req-56d3af38-65d2-46ec-b8ee-fc1f04d54f3e req-b946ddca-ba29-442f-af9a-10e4ecfcea6d service nova] Enqueued Resource ID: ea061614-3b2c-4a61-a74b-32a4b42f10a1 with Priority: HIGHEST for action security_group_rules [ 949.320068] env[62842]: INFO networking_nsxv3.common.synchronization [req-56d3af38-65d2-46ec-b8ee-fc1f04d54f3e req-b946ddca-ba29-442f-af9a-10e4ecfcea6d service nova] Enqueued Resource ID: ea061614-3b2c-4a61-a74b-32a4b42f10a1 with Priority: HIGHEST for action security_group_members [ 949.320068] env[62842]: INFO networking_nsxv3.common.synchronization [req-56d3af38-65d2-46ec-b8ee-fc1f04d54f3e req-b946ddca-ba29-442f-af9a-10e4ecfcea6d service nova] Enqueued Resource ID: 002b2eb1-90e1-49a2-b9b5-ddeb7728ab4e with Priority: HIGHEST for action port [ 949.320505] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea061614-3b2c-4a61-a74b-32a4b42f10a1 with Priority: HIGHEST for action security_group_rules [ 949.320593] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea061614-3b2c-4a61-a74b-32a4b42f10a1 with Priority: HIGHEST for action security_group_members [ 949.320703] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 002b2eb1-90e1-49a2-b9b5-ddeb7728ab4e with Priority: HIGHEST for action port [ 949.321024] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ea061614-3b2c-4a61-a74b-32a4b42f10a1 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.321205] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.321406] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea061614-3b2c-4a61-a74b-32a4b42f10a1 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.321604] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.321660] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-002b2eb1-90e1-49a2-b9b5-ddeb7728ab4e taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.321750] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-002b2eb1-90e1-49a2-b9b5-ddeb7728ab4e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.321828] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-002b2eb1-90e1-49a2-b9b5-ddeb7728ab4e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.322045] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-002b2eb1-90e1-49a2-b9b5-ddeb7728ab4e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.322128] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('002b2eb1-90e1-49a2-b9b5-ddeb7728ab4e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.389978] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.390183] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.390253] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.390526] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.390712] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.390818] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 is going to be updated. [ 949.421650] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.421898] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.421898] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.422159] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.422304] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.433632] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 in Status: IN_PROGRESS for 2s [ 949.436534] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ecbdf52-553d-43c4-b969-597ffc82c5d6 in Status: SUCCESS [ 949.436759] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ecbdf52-553d-43c4-b969-597ffc82c5d6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.444245] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.444393] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.444393] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.444650] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.444727] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.444800] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea061614-3b2c-4a61-a74b-32a4b42f10a1 is going to be updated. [ 949.479209] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.479361] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.479432] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.479651] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.479797] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.492204] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea061614-3b2c-4a61-a74b-32a4b42f10a1 in Status: IN_PROGRESS for 2s [ 949.830409] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 002b2eb1-90e1-49a2-b9b5-ddeb7728ab4e with status ACTIVE [ 949.830636] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.831765] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.831765] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.831765] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.831765] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.831765] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.832674] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.832674] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.832674] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.832674] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.833431] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.833431] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.833431] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.833610] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.833610] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.833702] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 002b2eb1-90e1-49a2-b9b5-ddeb7728ab4e is going to be updated. [ 949.860322] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.860523] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.860523] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.860724] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.860934] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.861105] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-002b2eb1-90e1-49a2-b9b5-ddeb7728ab4e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.918872] env[62842]: INFO networking_nsxv3.common.synchronization [req-ae639b5e-0dc9-44a8-91a9-43da04a3e0ef req-e9f213ff-3a5a-4f8f-add5-a0488d89577e service nova] Enqueued Resource ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 with Priority: HIGHEST for action security_group_rules [ 949.919071] env[62842]: INFO networking_nsxv3.common.synchronization [req-ae639b5e-0dc9-44a8-91a9-43da04a3e0ef req-e9f213ff-3a5a-4f8f-add5-a0488d89577e service nova] Enqueued Resource ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 with Priority: HIGHEST for action security_group_members [ 949.919220] env[62842]: INFO networking_nsxv3.common.synchronization [req-ae639b5e-0dc9-44a8-91a9-43da04a3e0ef req-e9f213ff-3a5a-4f8f-add5-a0488d89577e service nova] Enqueued Resource ID: 8b114873-0408-422e-8fd1-c66c3bc608c2 with Priority: HIGHEST for action port [ 949.919745] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 with Priority: HIGHEST for action security_group_rules [ 949.919878] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 with Priority: HIGHEST for action security_group_members [ 949.919974] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b114873-0408-422e-8fd1-c66c3bc608c2 with Priority: HIGHEST for action port [ 949.920261] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e90c0f27-4513-40eb-ba31-bf40f699d9a6 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.920361] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.920551] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e90c0f27-4513-40eb-ba31-bf40f699d9a6 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.920632] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.920874] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-8b114873-0408-422e-8fd1-c66c3bc608c2 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.920985] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8b114873-0408-422e-8fd1-c66c3bc608c2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.921062] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8b114873-0408-422e-8fd1-c66c3bc608c2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.921266] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8b114873-0408-422e-8fd1-c66c3bc608c2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.921344] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b114873-0408-422e-8fd1-c66c3bc608c2',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.423746] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8b114873-0408-422e-8fd1-c66c3bc608c2 with status ACTIVE [ 950.424215] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.424215] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.424374] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.424490] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.424591] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.424886] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.424983] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.424983] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.425246] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.425351] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.425607] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.425744] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.425815] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.425985] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.426098] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.426240] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8b114873-0408-422e-8fd1-c66c3bc608c2 is going to be updated. [ 950.448546] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.448700] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.448799] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.449039] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.449216] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.449398] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8b114873-0408-422e-8fd1-c66c3bc608c2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.446393] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 in Status: SUCCESS [ 951.446393] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.446800] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.446800] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.446916] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.447043] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.447108] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.447255] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.447336] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.447430] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e90c0f27-4513-40eb-ba31-bf40f699d9a6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.504356] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea061614-3b2c-4a61-a74b-32a4b42f10a1 in Status: SUCCESS [ 951.504638] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.504749] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.504982] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.505280] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.505435] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.505509] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.505683] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.505797] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.505927] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.506131] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea061614-3b2c-4a61-a74b-32a4b42f10a1 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.506647] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.506647] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.506647] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.506647] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.506892] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.506892] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.506892] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.506991] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.509450] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.509739] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ea061614-3b2c-4a61-a74b-32a4b42f10a1',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.511218] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.514737] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.514737] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.514737] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.514737] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.514737] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.514737] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.514737] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea061614-3b2c-4a61-a74b-32a4b42f10a1',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.950870] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e90c0f27-4513-40eb-ba31-bf40f699d9a6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.015913] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ea061614-3b2c-4a61-a74b-32a4b42f10a1: rpc.has_security_group_logging(os_id): False [ 952.017081] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ea061614-3b2c-4a61-a74b-32a4b42f10a1',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.036341] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.036341] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.036517] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.036782] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.036782] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.036896] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.037891] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.037891] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.037891] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.037891] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.037891] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.037891] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.037891] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.038311] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.038311] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.038311] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.038432] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.038432] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.038548] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.038614] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.038725] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ea061614-3b2c-4a61-a74b-32a4b42f10a1 is going to be created. [ 952.096969] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.096969] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.097166] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.097242] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.097419] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.110027] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ea061614-3b2c-4a61-a74b-32a4b42f10a1 in Status: IN_PROGRESS for 2s [ 952.396265] env[62842]: INFO networking_nsxv3.common.synchronization [req-812358e0-a0a9-4251-a95d-00b1d514eb97 req-9c15d552-bb32-4bab-9bce-11bdeb726335 tempest-ServersTestJSON-1267616671 tempest-ServersTestJSON-1267616671-project-member] Enqueued Resource ID: 074be4e0-ffc9-4ec9-b29a-40406844218c with Priority: HIGHEST for action security_group_members [ 952.396265] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 074be4e0-ffc9-4ec9-b29a-40406844218c with Priority: HIGHEST for action security_group_members [ 952.397964] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-074be4e0-ffc9-4ec9-b29a-40406844218c taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.398124] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.398741] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.398741] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.398741] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.398741] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.399061] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.399061] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.399127] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.400135] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.454766] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e90c0f27-4513-40eb-ba31-bf40f699d9a6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.520989] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ea061614-3b2c-4a61-a74b-32a4b42f10a1',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.905705] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.944244] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-509 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.944505] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-509" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.944607] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-509" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.944831] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-509" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.945223] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.945325] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.945401] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.945648] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.945876] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.945972] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 952.949127] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 952.949127] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 952.949127] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 952.949127] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 952.949127] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 952.949127] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 952.957215] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.957419] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.957524] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.957806] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.957920] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.958087] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 is going to be updated. [ 952.975184] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 952.975799] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 952.976059] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 952.976393] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-509" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.977056] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-2604307c-7bac-493d-9fc0-8580ffd443d8 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.977184] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-2604307c-7bac-493d-9fc0-8580ffd443d8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.977446] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-2604307c-7bac-493d-9fc0-8580ffd443d8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.977760] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-2604307c-7bac-493d-9fc0-8580ffd443d8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.977993] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2604307c-7bac-493d-9fc0-8580ffd443d8',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.993695] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.993865] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.994286] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.994286] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.994286] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.005086] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 in Status: IN_PROGRESS for 2s [ 953.023020] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.023313] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.023313] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.023479] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.023566] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.023667] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea061614-3b2c-4a61-a74b-32a4b42f10a1 is going to be updated. [ 953.062967] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.063226] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.063295] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.063494] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.063605] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.073999] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea061614-3b2c-4a61-a74b-32a4b42f10a1 in Status: IN_PROGRESS for 2s [ 953.408274] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.481371] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.481804] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.481804] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.482063] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.482240] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.482475] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 2604307c-7bac-493d-9fc0-8580ffd443d8 not found, creating... [ 953.482799] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.483062] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.483217] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.483510] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.483714] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.484100] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.484315] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.484477] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.484737] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.484908] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.485120] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 2604307c-7bac-493d-9fc0-8580ffd443d8 is going to be created. [ 953.505998] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.507498] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.507498] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.507498] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.507498] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.507498] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-2604307c-7bac-493d-9fc0-8580ffd443d8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.911491] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.911697] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.911738] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.912051] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.912129] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.912303] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 074be4e0-ffc9-4ec9-b29a-40406844218c is going to be updated. [ 953.952658] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.952658] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.952658] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.953042] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.953042] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.970544] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 074be4e0-ffc9-4ec9-b29a-40406844218c in Status: IN_PROGRESS for 2s [ 954.128518] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ea061614-3b2c-4a61-a74b-32a4b42f10a1 in Status: SUCCESS [ 954.128827] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.128972] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.129384] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.129384] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ea061614-3b2c-4a61-a74b-32a4b42f10a1',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.315894] env[62842]: INFO networking_nsxv3.common.synchronization [req-812358e0-a0a9-4251-a95d-00b1d514eb97 req-90666409-d348-47d5-8316-9019f886dc76 service nova] Enqueued Resource ID: 074be4e0-ffc9-4ec9-b29a-40406844218c with Priority: HIGHEST for action security_group_rules [ 954.316112] env[62842]: INFO networking_nsxv3.common.synchronization [req-812358e0-a0a9-4251-a95d-00b1d514eb97 req-90666409-d348-47d5-8316-9019f886dc76 service nova] Enqueued Resource ID: 074be4e0-ffc9-4ec9-b29a-40406844218c with Priority: HIGHEST for action security_group_members [ 954.316257] env[62842]: INFO networking_nsxv3.common.synchronization [req-812358e0-a0a9-4251-a95d-00b1d514eb97 req-90666409-d348-47d5-8316-9019f886dc76 service nova] Enqueued Resource ID: 2604307c-7bac-493d-9fc0-8580ffd443d8 with Priority: HIGHEST for action port [ 954.318458] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 074be4e0-ffc9-4ec9-b29a-40406844218c with Priority: HIGHEST for action security_group_rules [ 954.318604] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 074be4e0-ffc9-4ec9-b29a-40406844218c with Priority: HIGHEST for action security_group_members [ 954.318778] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2604307c-7bac-493d-9fc0-8580ffd443d8 with Priority: HIGHEST for action port [ 954.319143] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-074be4e0-ffc9-4ec9-b29a-40406844218c taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.319273] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.319337] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.319544] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.319626] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.320500] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-074be4e0-ffc9-4ec9-b29a-40406844218c taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.320596] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.320845] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-2604307c-7bac-493d-9fc0-8580ffd443d8 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.321059] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2604307c-7bac-493d-9fc0-8580ffd443d8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.321059] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2604307c-7bac-493d-9fc0-8580ffd443d8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.321993] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2604307c-7bac-493d-9fc0-8580ffd443d8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.322118] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2604307c-7bac-493d-9fc0-8580ffd443d8',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.632468] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea061614-3b2c-4a61-a74b-32a4b42f10a1 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.632896] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.824381] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-074be4e0-ffc9-4ec9-b29a-40406844218c taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.824609] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.824699] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2604307c-7bac-493d-9fc0-8580ffd443d8 with status ACTIVE [ 954.824849] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.824954] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.825029] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.825243] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.825328] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.825508] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.825605] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.825664] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.825868] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.825868] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.826063] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.826180] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.826244] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.826345] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.826422] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.826485] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2604307c-7bac-493d-9fc0-8580ffd443d8 is going to be updated. [ 954.848522] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.849155] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.849155] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.849155] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.849155] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.849440] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2604307c-7bac-493d-9fc0-8580ffd443d8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.015765] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 in Status: SUCCESS [ 955.015994] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.016174] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.016470] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.016700] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.016819] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.016895] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.017054] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.017201] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.017320] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.017437] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e90c0f27-4513-40eb-ba31-bf40f699d9a6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.018304] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.018504] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.018704] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.018865] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.018965] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.019162] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.019259] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.019398] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e90c0f27-4513-40eb-ba31-bf40f699d9a6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.085615] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea061614-3b2c-4a61-a74b-32a4b42f10a1 in Status: SUCCESS [ 955.085903] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.086092] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.086302] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.086495] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.086723] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.086723] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.086845] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.086900] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.086967] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.087078] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ea061614-3b2c-4a61-a74b-32a4b42f10a1',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.331741] env[62842]: INFO networking_nsxv3.common.synchronization [req-94ea048b-b2e2-4569-805b-28653b021936 req-ee5114c6-6364-4503-80f8-059f9c7dd55b tempest-ServerMetadataNegativeTestJSON-162207829 tempest-ServerMetadataNegativeTestJSON-162207829-project-member] Enqueued Resource ID: 1ecbdf52-553d-43c4-b969-597ffc82c5d6 with Priority: HIGHEST for action security_group_members [ 955.333257] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ecbdf52-553d-43c4-b969-597ffc82c5d6 with Priority: HIGHEST for action security_group_members [ 955.333257] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ecbdf52-553d-43c4-b969-597ffc82c5d6 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.333257] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ecbdf52-553d-43c4-b969-597ffc82c5d6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.333562] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ecbdf52-553d-43c4-b969-597ffc82c5d6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.333697] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ecbdf52-553d-43c4-b969-597ffc82c5d6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.333955] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.334148] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.334266] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.334520] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.334660] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.334820] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ecbdf52-553d-43c4-b969-597ffc82c5d6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.521363] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e90c0f27-4513-40eb-ba31-bf40f699d9a6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.523127] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e90c0f27-4513-40eb-ba31-bf40f699d9a6 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.523478] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.589883] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea061614-3b2c-4a61-a74b-32a4b42f10a1 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.590121] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.590215] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.590531] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.591312] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.591312] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.591312] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.591312] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.593260] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.593260] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.593260] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea061614-3b2c-4a61-a74b-32a4b42f10a1 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.593260] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.593260] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.593260] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.593260] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.593260] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.593260] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.593260] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.593260] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.593260] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.593260] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ea061614-3b2c-4a61-a74b-32a4b42f10a1',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.838194] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.838194] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.838194] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.838194] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.838194] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.838650] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.838650] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.838650] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.838650] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.838879] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.838879] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ecbdf52-553d-43c4-b969-597ffc82c5d6 is going to be updated. [ 955.866213] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.866299] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.866334] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.866643] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.866834] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.877890] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ecbdf52-553d-43c4-b969-597ffc82c5d6 in Status: IN_PROGRESS for 2s [ 955.981562] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 074be4e0-ffc9-4ec9-b29a-40406844218c in Status: SUCCESS [ 955.981785] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.981959] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.982192] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.982384] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.982503] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.982561] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.982710] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.982793] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.982891] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.024601] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e90c0f27-4513-40eb-ba31-bf40f699d9a6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.095125] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ea061614-3b2c-4a61-a74b-32a4b42f10a1: rpc.has_security_group_logging(os_id): False [ 956.112746] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.112978] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.112978] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.113178] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.113267] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.113480] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.113576] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.113639] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.113771] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.113845] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.114068] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.114168] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.114228] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.114366] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.114440] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.114611] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.114701] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.114754] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.114888] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.114959] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.115053] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ea061614-3b2c-4a61-a74b-32a4b42f10a1 is going to be updated. [ 956.175298] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.175500] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.175548] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.175739] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.175880] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.189596] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ea061614-3b2c-4a61-a74b-32a4b42f10a1 in Status: IN_PROGRESS for 2s [ 956.485266] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.527654] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.527861] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.527952] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.528216] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.528311] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.528444] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 is going to be updated. [ 956.558319] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.558487] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.558552] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.558806] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.558960] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.569503] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 in Status: IN_PROGRESS for 2s [ 956.987725] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.247082] env[62842]: INFO networking_nsxv3.common.synchronization [req-4028f7ed-f028-4970-af3e-897e0f729afa req-a18920ba-ecab-4efd-baa9-cd0e9bef0e38 tempest-DeleteServersTestJSON-1113791748 tempest-DeleteServersTestJSON-1113791748-project-member] Enqueued Resource ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 with Priority: HIGHEST for action security_group_members [ 957.247746] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 with Priority: HIGHEST for action security_group_members [ 957.248181] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-35146777-fd28-4ac7-b454-f7dd3fbb5846 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.248316] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.248431] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.248733] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.248937] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.249056] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.249137] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.249317] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.249588] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.249588] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('35146777-fd28-4ac7-b454-f7dd3fbb5846',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.490274] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.490464] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.490512] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.490697] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.490783] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.490946] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 074be4e0-ffc9-4ec9-b29a-40406844218c is going to be updated. [ 957.521895] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.522106] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.522181] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.522404] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.522551] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.533524] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 074be4e0-ffc9-4ec9-b29a-40406844218c in Status: IN_PROGRESS for 2s [ 957.755529] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.755697] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.755742] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.755945] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.756054] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.756276] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.756365] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.756412] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.756566] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.756642] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.756729] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 is going to be updated. [ 957.766502] env[62842]: INFO networking_nsxv3.common.synchronization [req-afd235c7-982e-4fc6-8dd2-40295a91fa0c req-80b6917a-41c1-4233-98e2-090f3b5a58bf tempest-ServersAdminNegativeTestJSON-1401896846 tempest-ServersAdminNegativeTestJSON-1401896846-project-member] Enqueued Resource ID: b47c6fcc-dd2d-4dd3-979a-610c0739cfd0 with Priority: HIGHEST for action security_group_members [ 957.767118] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b47c6fcc-dd2d-4dd3-979a-610c0739cfd0 with Priority: HIGHEST for action security_group_members [ 957.767437] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.767559] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.767625] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.767821] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.767974] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.768086] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.768147] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.768302] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.768389] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.768480] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b47c6fcc-dd2d-4dd3-979a-610c0739cfd0',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.806809] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.806809] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.806809] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.806809] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.806809] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.816528] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 in Status: IN_PROGRESS for 2s [ 957.889581] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ecbdf52-553d-43c4-b969-597ffc82c5d6 in Status: SUCCESS [ 957.889759] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ecbdf52-553d-43c4-b969-597ffc82c5d6 deletion is rescheduled due to dependency. [ 957.889876] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ecbdf52-553d-43c4-b969-597ffc82c5d6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.043697] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-681 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.044121] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-681" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.044235] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-681" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.044654] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-681" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.044985] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.045202] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.045334] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.045579] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.045754] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.045968] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 958.046098] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 958.046265] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 958.046448] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 958.046629] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 958.046825] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 958.047028] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 958.069995] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 958.070190] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 958.070335] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 958.070526] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-681" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.070973] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-ad97fe9b-8989-440b-89df-a5b09d1e438d taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.071113] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-ad97fe9b-8989-440b-89df-a5b09d1e438d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.071226] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-ad97fe9b-8989-440b-89df-a5b09d1e438d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.071630] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-ad97fe9b-8989-440b-89df-a5b09d1e438d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.071781] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad97fe9b-8989-440b-89df-a5b09d1e438d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.203222] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ea061614-3b2c-4a61-a74b-32a4b42f10a1 in Status: SUCCESS [ 958.203444] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.273882] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.273882] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.273882] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.273882] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.273882] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.273882] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.273882] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.273882] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.273882] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.273882] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.273882] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b47c6fcc-dd2d-4dd3-979a-610c0739cfd0 is going to be updated. [ 958.306561] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.306561] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.306561] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.306561] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.306561] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.314679] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b47c6fcc-dd2d-4dd3-979a-610c0739cfd0 in Status: IN_PROGRESS for 2s [ 958.575389] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.575616] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.575749] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.576043] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.576238] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.576354] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port ad97fe9b-8989-440b-89df-a5b09d1e438d not found, creating... [ 958.576916] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.576916] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.576916] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.577172] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.577310] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.577602] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.577764] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.577884] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.578122] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.578266] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.578409] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: ad97fe9b-8989-440b-89df-a5b09d1e438d is going to be created. [ 958.581177] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 in Status: SUCCESS [ 958.581177] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.581177] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.581177] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.581177] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.581177] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.581177] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.581177] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.581177] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.581543] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.581543] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e90c0f27-4513-40eb-ba31-bf40f699d9a6 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.581543] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.581543] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.581710] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.581752] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.581961] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.581961] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.582142] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.582197] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.582251] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.582346] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e90c0f27-4513-40eb-ba31-bf40f699d9a6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.606242] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.606543] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.606682] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.607074] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.607207] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.607444] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-ad97fe9b-8989-440b-89df-a5b09d1e438d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.843275] env[62842]: INFO networking_nsxv3.common.synchronization [req-0cfc1b1b-c1bf-4daa-bc9a-20838a2903b2 req-2b1e0092-9c22-4781-b0d6-79c57aecb8e7 tempest-ServersV294TestFqdnHostnames-685604315 tempest-ServersV294TestFqdnHostnames-685604315-project-member] Enqueued Resource ID: bc98288b-6b97-448c-a5b8-54058cb0d341 with Priority: HIGHEST for action security_group_members [ 958.848471] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc98288b-6b97-448c-a5b8-54058cb0d341 with Priority: HIGHEST for action security_group_members [ 958.849730] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc98288b-6b97-448c-a5b8-54058cb0d341 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.850093] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc98288b-6b97-448c-a5b8-54058cb0d341" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.850275] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc98288b-6b97-448c-a5b8-54058cb0d341" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.850593] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc98288b-6b97-448c-a5b8-54058cb0d341" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.850935] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.851196] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.851345] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.851608] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.851791] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.851980] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc98288b-6b97-448c-a5b8-54058cb0d341',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.085169] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e90c0f27-4513-40eb-ba31-bf40f699d9a6: rpc.has_security_group_logging(os_id): False [ 959.104757] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.105043] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.105043] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.105228] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.105323] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.105532] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.105693] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.105693] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.105860] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.105945] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.106197] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.106331] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.106410] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.106559] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.106641] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.106830] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.106937] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.107020] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.107189] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.107304] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.107402] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 is going to be updated. [ 959.196565] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.196714] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.196776] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.196986] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.197149] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.217161] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 in Status: IN_PROGRESS for 2s [ 959.357627] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.357840] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.357840] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.358617] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.358617] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.358617] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.358617] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.358617] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.358962] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.358962] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.358962] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc98288b-6b97-448c-a5b8-54058cb0d341 is going to be updated. [ 959.392341] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.392599] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.392599] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.392680] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.394076] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.404179] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc98288b-6b97-448c-a5b8-54058cb0d341 in Status: IN_PROGRESS for 2s [ 959.546092] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 074be4e0-ffc9-4ec9-b29a-40406844218c in Status: SUCCESS [ 959.546321] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.546506] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.546729] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.546919] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.547137] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.547211] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.547371] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.547453] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.547545] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.547638] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.554497] env[62842]: INFO networking_nsxv3.common.synchronization [req-4028f7ed-f028-4970-af3e-897e0f729afa req-6d48f91b-865e-440f-80cc-f05af5c1d0d8 service nova] Enqueued Resource ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 with Priority: HIGHEST for action security_group_rules [ 959.554678] env[62842]: INFO networking_nsxv3.common.synchronization [req-4028f7ed-f028-4970-af3e-897e0f729afa req-6d48f91b-865e-440f-80cc-f05af5c1d0d8 service nova] Enqueued Resource ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 with Priority: HIGHEST for action security_group_members [ 959.554820] env[62842]: INFO networking_nsxv3.common.synchronization [req-4028f7ed-f028-4970-af3e-897e0f729afa req-6d48f91b-865e-440f-80cc-f05af5c1d0d8 service nova] Enqueued Resource ID: ad97fe9b-8989-440b-89df-a5b09d1e438d with Priority: HIGHEST for action port [ 959.555167] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 with Priority: HIGHEST for action security_group_rules [ 959.555316] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 with Priority: HIGHEST for action security_group_members [ 959.555414] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad97fe9b-8989-440b-89df-a5b09d1e438d with Priority: HIGHEST for action port [ 959.556017] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-35146777-fd28-4ac7-b454-f7dd3fbb5846 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.556390] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.556446] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.556654] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.556736] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('35146777-fd28-4ac7-b454-f7dd3fbb5846',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.557656] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-35146777-fd28-4ac7-b454-f7dd3fbb5846 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.557745] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.557897] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad97fe9b-8989-440b-89df-a5b09d1e438d taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.558055] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad97fe9b-8989-440b-89df-a5b09d1e438d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.558055] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad97fe9b-8989-440b-89df-a5b09d1e438d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.558231] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad97fe9b-8989-440b-89df-a5b09d1e438d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.558302] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad97fe9b-8989-440b-89df-a5b09d1e438d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.832136] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 in Status: SUCCESS [ 959.832326] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 deletion is rescheduled due to dependency. [ 959.832451] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.832604] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.832862] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.833068] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.833188] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.833250] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.833410] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.833499] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.833597] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('35146777-fd28-4ac7-b454-f7dd3fbb5846',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.049770] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-074be4e0-ffc9-4ec9-b29a-40406844218c taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.051779] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.051779] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.052048] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.052736] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.052736] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.052736] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.052736] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.052736] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.052980] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.053224] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-074be4e0-ffc9-4ec9-b29a-40406844218c taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.053398] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.057358] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.057358] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.057358] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.057358] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.057358] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.057358] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.057358] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.057358] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.057358] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.060792] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-35146777-fd28-4ac7-b454-f7dd3fbb5846 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.060792] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.062527] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ad97fe9b-8989-440b-89df-a5b09d1e438d with status ACTIVE [ 960.062787] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.062957] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.063091] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.063400] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.063550] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.063839] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.064018] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.064120] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.064360] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.064477] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.064794] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.064989] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.065620] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.065620] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.065620] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.066276] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ad97fe9b-8989-440b-89df-a5b09d1e438d is going to be updated. [ 960.093934] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.094280] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.094280] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.094422] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.094511] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.094684] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad97fe9b-8989-440b-89df-a5b09d1e438d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.325543] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b47c6fcc-dd2d-4dd3-979a-610c0739cfd0 in Status: SUCCESS [ 960.325543] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b47c6fcc-dd2d-4dd3-979a-610c0739cfd0 deletion is rescheduled due to dependency. [ 960.325543] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.338071] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('35146777-fd28-4ac7-b454-f7dd3fbb5846',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.559512] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 074be4e0-ffc9-4ec9-b29a-40406844218c: rpc.has_security_group_logging(os_id): False [ 960.579396] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.579568] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.579612] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.579798] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.579874] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.580111] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.580237] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.580312] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.581789] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.581789] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.581789] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.581789] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.581789] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.581789] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.581789] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.581789] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.581789] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.581789] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.581789] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.581789] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.581789] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 074be4e0-ffc9-4ec9-b29a-40406844218c is going to be updated. [ 960.646009] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.646194] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.646267] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.646570] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.646753] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.661980] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 074be4e0-ffc9-4ec9-b29a-40406844218c in Status: IN_PROGRESS for 2s [ 960.842544] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('35146777-fd28-4ac7-b454-f7dd3fbb5846',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.235501] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 in Status: SUCCESS [ 961.235808] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.235868] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.236133] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.236227] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e90c0f27-4513-40eb-ba31-bf40f699d9a6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.344765] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.344963] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.345057] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.345417] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.345417] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.345488] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 is going to be updated. [ 961.376687] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.376864] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.377088] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.377192] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.377746] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.387222] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 in Status: IN_PROGRESS for 2s [ 961.414378] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc98288b-6b97-448c-a5b8-54058cb0d341 in Status: SUCCESS [ 961.415568] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc98288b-6b97-448c-a5b8-54058cb0d341 deletion is rescheduled due to dependency. [ 961.415662] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc98288b-6b97-448c-a5b8-54058cb0d341" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.740582] env[62842]: INFO networking_nsxv3.common.synchronization [req-f96d1d68-d752-4eef-b34e-cb9c1a19f54c req-11601781-5916-40d8-a9c4-f133df36add3 tempest-ServersTestMultiNic-2049983028 tempest-ServersTestMultiNic-2049983028-project-member] Enqueued Resource ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 with Priority: HIGHEST for action security_group_members [ 961.740992] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e90c0f27-4513-40eb-ba31-bf40f699d9a6 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.741152] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.741329] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.741397] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.741541] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.741630] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.741690] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.741853] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.741952] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.742290] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.742463] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e90c0f27-4513-40eb-ba31-bf40f699d9a6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.743596] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 with Priority: HIGHEST for action security_group_members [ 961.744203] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e90c0f27-4513-40eb-ba31-bf40f699d9a6 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.744331] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.744484] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.744600] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.744778] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.744896] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.745050] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.745174] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.745281] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.745376] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e90c0f27-4513-40eb-ba31-bf40f699d9a6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.824757] env[62842]: INFO networking_nsxv3.common.synchronization [None req-a5554912-536c-4a7c-957f-4cdfd87b781d tempest-AttachVolumeNegativeTest-1420230652 tempest-AttachVolumeNegativeTest-1420230652-project-member] Enqueued Resource ID: c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311 with Priority: HIGHEST for action security_group_rules [ 961.826250] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311 with Priority: HIGHEST for action security_group_rules [ 961.826785] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.827854] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.827854] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.827854] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.827854] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.932798] env[62842]: INFO networking_nsxv3.common.synchronization [None req-7d8ec655-8e30-4d25-b727-69d85670263f tempest-AttachVolumeNegativeTest-1420230652 tempest-AttachVolumeNegativeTest-1420230652-project-member] Enqueued Resource ID: c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311 with Priority: HIGHEST for action security_group_rules [ 961.933558] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311 with Priority: HIGHEST for action security_group_rules [ 961.933759] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.933866] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.162857] env[62842]: INFO networking_nsxv3.common.synchronization [req-f96d1d68-d752-4eef-b34e-cb9c1a19f54c req-f6610a48-8ce1-4020-99e2-f3f041d0fc1f tempest-ServersTestMultiNic-2049983028 tempest-ServersTestMultiNic-2049983028-project-member] Enqueued Resource ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 with Priority: HIGHEST for action security_group_members [ 962.167583] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 with Priority: HIGHEST for action security_group_members [ 962.167583] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e90c0f27-4513-40eb-ba31-bf40f699d9a6 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.167583] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.245616] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e90c0f27-4513-40eb-ba31-bf40f699d9a6 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.245616] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.247963] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e90c0f27-4513-40eb-ba31-bf40f699d9a6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.351443] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.354068] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.354068] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.354068] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.354068] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.354068] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311 already deleted. [ 962.354068] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.354068] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.354068] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.354068] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.677022] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 074be4e0-ffc9-4ec9-b29a-40406844218c in Status: SUCCESS [ 962.677368] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.751214] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e90c0f27-4513-40eb-ba31-bf40f699d9a6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.876033] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.876231] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.876344] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.877107] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.877107] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.877107] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311 already deleted. [ 962.877107] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.254124] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.254455] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.254455] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.254534] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.254622] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.254721] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 is going to be updated. [ 963.286103] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.286260] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.286327] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.286543] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.286683] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.300964] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 in Status: IN_PROGRESS for 2s [ 963.399644] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 in Status: SUCCESS [ 963.400225] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.400373] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.400610] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.400827] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.401102] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.401183] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.401484] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.401484] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.401606] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.401706] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('35146777-fd28-4ac7-b454-f7dd3fbb5846',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.903959] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-35146777-fd28-4ac7-b454-f7dd3fbb5846 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.905259] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.905259] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.905259] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.905259] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.905259] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.905259] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.905539] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.905539] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.905539] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.905700] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-35146777-fd28-4ac7-b454-f7dd3fbb5846 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.905750] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.905783] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.906009] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.906235] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.906360] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.906441] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.906628] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.906727] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.906816] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.906912] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('35146777-fd28-4ac7-b454-f7dd3fbb5846',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.983352] env[62842]: INFO networking_nsxv3.common.synchronization [req-814cf3ce-9759-4195-8e27-654bf127fbe7 req-34122698-8e3b-4ede-8904-6ba8beaadfb9 tempest-AttachVolumeTestJSON-43280943 tempest-AttachVolumeTestJSON-43280943-project-member] Enqueued Resource ID: c59f85b7-500a-400b-bef3-55b5e589248f with Priority: HIGHEST for action security_group_members [ 963.983954] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c59f85b7-500a-400b-bef3-55b5e589248f with Priority: HIGHEST for action security_group_members [ 963.984332] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-c59f85b7-500a-400b-bef3-55b5e589248f taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.984478] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c59f85b7-500a-400b-bef3-55b5e589248f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.984609] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c59f85b7-500a-400b-bef3-55b5e589248f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.984830] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c59f85b7-500a-400b-bef3-55b5e589248f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.985390] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.985519] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.985594] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.985756] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.985845] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.985937] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c59f85b7-500a-400b-bef3-55b5e589248f',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.412029] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 35146777-fd28-4ac7-b454-f7dd3fbb5846: rpc.has_security_group_logging(os_id): False [ 964.431282] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.431476] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.431476] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.431688] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.431787] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.432122] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.432222] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.432286] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.432445] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.432518] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.432799] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.432853] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.433041] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.433041] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.433165] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.434189] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.434189] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.434189] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.434189] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.435168] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.435168] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 is going to be updated. [ 964.492062] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.492062] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.492062] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.492062] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.492062] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.492062] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.492062] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.492062] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.492062] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.492062] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.492062] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c59f85b7-500a-400b-bef3-55b5e589248f is going to be updated. [ 964.507273] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.507548] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.507673] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.508114] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.508201] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.524379] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 in Status: IN_PROGRESS for 2s [ 964.527398] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.527533] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.527607] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.527820] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.527957] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.537414] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c59f85b7-500a-400b-bef3-55b5e589248f in Status: IN_PROGRESS for 2s [ 965.315113] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 in Status: SUCCESS [ 965.315113] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.315302] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.315512] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.315646] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.315763] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.315823] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.315965] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.316048] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.316148] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e90c0f27-4513-40eb-ba31-bf40f699d9a6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.822154] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.822505] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.822505] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.822576] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.822622] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.822825] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.822922] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.822984] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.823143] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.823271] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.823339] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 is going to be updated. [ 965.852985] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.853146] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.853274] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.853411] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.853548] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.864434] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 in Status: IN_PROGRESS for 2s [ 966.409341] env[62842]: INFO networking_nsxv3.common.synchronization [req-950886b9-764f-4399-8ea0-debacd7ff6cd req-56f92c2d-1571-4254-a925-32aed38596cd tempest-ServersTestJSON-1267616671 tempest-ServersTestJSON-1267616671-project-member] Enqueued Resource ID: 074be4e0-ffc9-4ec9-b29a-40406844218c with Priority: HIGHEST for action security_group_members [ 966.409341] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 074be4e0-ffc9-4ec9-b29a-40406844218c with Priority: HIGHEST for action security_group_members [ 966.409341] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-074be4e0-ffc9-4ec9-b29a-40406844218c taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.409341] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.409341] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.409341] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.409341] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.409341] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.413644] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.413644] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.413644] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.413644] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.555011] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c59f85b7-500a-400b-bef3-55b5e589248f in Status: SUCCESS [ 966.555011] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c59f85b7-500a-400b-bef3-55b5e589248f deletion is rescheduled due to dependency. [ 966.555011] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c59f85b7-500a-400b-bef3-55b5e589248f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.562896] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 in Status: SUCCESS [ 966.563344] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.915744] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.418217] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.875807] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 in Status: SUCCESS [ 967.875807] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 deletion is rescheduled due to dependency. [ 967.876494] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.876494] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.876738] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.876979] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.877196] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.877381] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.877589] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.877793] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.877932] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.878505] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-e90c0f27-4513-40eb-ba31-bf40f699d9a6 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.878505] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.878505] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.878505] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.878769] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.879557] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.879633] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.879794] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.879875] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.879960] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.880098] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e90c0f27-4513-40eb-ba31-bf40f699d9a6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.921434] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.921784] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.921784] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.921961] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.922136] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.922279] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 074be4e0-ffc9-4ec9-b29a-40406844218c is going to be updated. [ 967.953930] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.954096] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.954167] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.954546] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.954696] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.964672] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 074be4e0-ffc9-4ec9-b29a-40406844218c in Status: IN_PROGRESS for 2s [ 968.382202] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e90c0f27-4513-40eb-ba31-bf40f699d9a6: rpc.has_security_group_logging(os_id): False [ 968.405484] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.405675] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.405727] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.405980] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.407311] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.407577] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.407913] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.408211] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.408462] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.408621] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.408959] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.409168] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.409269] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.409738] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.409867] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.410168] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.410318] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.410423] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.410643] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.410776] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.410943] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 is going to be updated. [ 968.486548] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.486700] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.486768] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.486989] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.487150] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.504195] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 in Status: IN_PROGRESS for 2s [ 968.544267] env[62842]: INFO networking_nsxv3.common.synchronization [req-e1debfe6-4f1e-458c-bf0e-da0fd58434e3 req-cba928b4-0bfc-4807-8175-52c8cd015e0e tempest-FloatingIPsAssociationTestJSON-1346363058 tempest-FloatingIPsAssociationTestJSON-1346363058-project-member] Enqueued Resource ID: 47118de8-4ba9-49a6-bc4b-d030be1e7c79 with Priority: HIGHEST for action security_group_members [ 968.544892] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47118de8-4ba9-49a6-bc4b-d030be1e7c79 with Priority: HIGHEST for action security_group_members [ 968.545769] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-47118de8-4ba9-49a6-bc4b-d030be1e7c79 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.545769] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.545769] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.545769] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.545769] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.546067] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.546067] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.546067] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.546160] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.546192] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47118de8-4ba9-49a6-bc4b-d030be1e7c79',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.049044] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.049044] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.049044] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.049044] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.049044] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.049572] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.049572] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.049572] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.049572] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.049738] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.049738] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47118de8-4ba9-49a6-bc4b-d030be1e7c79 is going to be updated. [ 969.090355] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.090580] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.090580] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.090787] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.090986] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.102231] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47118de8-4ba9-49a6-bc4b-d030be1e7c79 in Status: IN_PROGRESS for 2s [ 969.983940] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 074be4e0-ffc9-4ec9-b29a-40406844218c in Status: SUCCESS [ 969.984190] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.522316] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 in Status: SUCCESS [ 970.522566] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.113732] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47118de8-4ba9-49a6-bc4b-d030be1e7c79 in Status: SUCCESS [ 971.113973] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47118de8-4ba9-49a6-bc4b-d030be1e7c79 deletion is rescheduled due to dependency. [ 971.114069] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.551227] env[62842]: INFO networking_nsxv3.common.synchronization [req-84e19079-5062-4289-aa1a-84d2ec5c28b2 req-4e977e68-571f-4736-a73e-e477ab2969cb tempest-ServerActionsTestJSON-670456711 tempest-ServerActionsTestJSON-670456711-project-member] Enqueued Resource ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 with Priority: HIGHEST for action security_group_members [ 971.551227] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 with Priority: HIGHEST for action security_group_members [ 971.551227] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a03224f-b75b-48a5-9e23-3ca50aabbb33 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.551227] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.551227] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.551227] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.553184] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.553364] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.553437] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.553675] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.553770] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.553883] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a03224f-b75b-48a5-9e23-3ca50aabbb33',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.056604] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.056748] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.056870] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.057051] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.083525] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.083911] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.083911] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.084589] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.084589] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.084589] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.084589] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 is going to be updated. [ 972.112369] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.113119] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.113119] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.113119] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.113119] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.128521] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 in Status: IN_PROGRESS for 2s [ 974.001599] env[62842]: INFO networking_nsxv3.common.synchronization [req-8c9e47a5-f292-4830-87e7-f7c5d800e10e req-cd7ac783-1e04-4109-a935-73ff3461bac5 tempest-DeleteServersTestJSON-1113791748 tempest-DeleteServersTestJSON-1113791748-project-member] Enqueued Resource ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 with Priority: HIGHEST for action security_group_members [ 974.009262] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 with Priority: HIGHEST for action security_group_members [ 974.009262] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-35146777-fd28-4ac7-b454-f7dd3fbb5846 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.009262] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.009262] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.009262] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.009262] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.009262] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.009262] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.009262] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.009262] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.009262] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('35146777-fd28-4ac7-b454-f7dd3fbb5846',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.142161] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 in Status: SUCCESS [ 974.142462] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 deletion is rescheduled due to dependency. [ 974.142650] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.510981] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.510981] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.512168] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.512168] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.512168] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.512389] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.512491] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.512574] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.512705] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.512779] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.512867] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 is going to be updated. [ 974.545207] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.545345] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.545416] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.546490] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.546736] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.557171] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 in Status: IN_PROGRESS for 2s [ 976.568241] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 in Status: SUCCESS [ 976.568553] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 deletion is rescheduled due to dependency. [ 976.568553] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.101652] env[62842]: INFO networking_nsxv3.common.synchronization [None req-0d8cb1fc-0496-43b5-b778-051fb1280962 None None] Enqueued Resource ID: c4643d56-c3e7-4635-aaef-0c7c49edfeca with Priority: HIGHEST for action port [ 977.106741] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4643d56-c3e7-4635-aaef-0c7c49edfeca with Priority: HIGHEST for action port [ 977.108840] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-c4643d56-c3e7-4635-aaef-0c7c49edfeca taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.108840] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c4643d56-c3e7-4635-aaef-0c7c49edfeca" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.108840] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c4643d56-c3e7-4635-aaef-0c7c49edfeca" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.108840] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c4643d56-c3e7-4635-aaef-0c7c49edfeca" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.108840] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4643d56-c3e7-4635-aaef-0c7c49edfeca',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.610755] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c4643d56-c3e7-4635-aaef-0c7c49edfeca [ 977.611088] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.611206] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.612425] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.612425] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.612425] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.612425] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c4643d56-c3e7-4635-aaef-0c7c49edfeca already deleted. [ 977.612425] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c4643d56-c3e7-4635-aaef-0c7c49edfeca" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.179500] env[62842]: INFO networking_nsxv3.common.synchronization [req-bab942a6-c450-48e4-9437-24445e1128ac req-de18b85d-4f42-4ad2-addd-8e9bcade27f6 tempest-ServerActionsTestOtherA-1611322165 tempest-ServerActionsTestOtherA-1611322165-project-member] Enqueued Resource ID: a28c97db-60c3-43e3-8413-1620ac6f1f6d with Priority: HIGHEST for action security_group_members [ 978.179500] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a28c97db-60c3-43e3-8413-1620ac6f1f6d with Priority: HIGHEST for action security_group_members [ 978.179500] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-a28c97db-60c3-43e3-8413-1620ac6f1f6d taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.179681] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a28c97db-60c3-43e3-8413-1620ac6f1f6d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.179681] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a28c97db-60c3-43e3-8413-1620ac6f1f6d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.179954] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a28c97db-60c3-43e3-8413-1620ac6f1f6d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.180305] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.180464] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.180572] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.180819] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.181035] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.181160] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a28c97db-60c3-43e3-8413-1620ac6f1f6d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.685985] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.685985] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.685985] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.685985] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.697563] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-8 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.698059] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.698427] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.698868] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.702032] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.702032] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.702032] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.702032] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.702032] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.702032] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 978.702032] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 978.702032] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 978.702032] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 978.702032] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 978.702032] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 978.702032] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 978.711098] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.711385] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.711511] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.711558] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.711793] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.711886] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.711944] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a28c97db-60c3-43e3-8413-1620ac6f1f6d is going to be updated. [ 978.731965] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 978.731965] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 978.731965] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 978.731965] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.733393] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-152c309b-7b9a-47fb-8f7f-b0b9c73a5440 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.733648] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-152c309b-7b9a-47fb-8f7f-b0b9c73a5440" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.734018] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-152c309b-7b9a-47fb-8f7f-b0b9c73a5440" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.734157] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-152c309b-7b9a-47fb-8f7f-b0b9c73a5440" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.734465] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('152c309b-7b9a-47fb-8f7f-b0b9c73a5440',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.759020] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.759020] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.759020] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.759020] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.759020] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.768789] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a28c97db-60c3-43e3-8413-1620ac6f1f6d in Status: IN_PROGRESS for 2s [ 979.237090] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.240454] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.240605] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.240912] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.241751] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.241751] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 152c309b-7b9a-47fb-8f7f-b0b9c73a5440 not found, creating... [ 979.241751] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.241960] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.242022] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.242335] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.242719] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.243871] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.244196] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.244746] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.245085] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.245320] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.245744] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 152c309b-7b9a-47fb-8f7f-b0b9c73a5440 is going to be created. [ 979.267817] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.268509] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.268725] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.269110] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.269423] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.269707] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-152c309b-7b9a-47fb-8f7f-b0b9c73a5440" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.484971] env[62842]: INFO networking_nsxv3.common.synchronization [None req-a0198191-f640-4e6d-8937-452f3c5cc23f None None] Enqueued Resource ID: 8c67e08f-d787-44cf-992a-7bb34d46c5e3 with Priority: HIGHEST for action port [ 979.485311] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c67e08f-d787-44cf-992a-7bb34d46c5e3 with Priority: HIGHEST for action port [ 979.485971] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c67e08f-d787-44cf-992a-7bb34d46c5e3 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.486110] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c67e08f-d787-44cf-992a-7bb34d46c5e3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.486344] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c67e08f-d787-44cf-992a-7bb34d46c5e3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.486745] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c67e08f-d787-44cf-992a-7bb34d46c5e3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.486802] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c67e08f-d787-44cf-992a-7bb34d46c5e3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.988904] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8c67e08f-d787-44cf-992a-7bb34d46c5e3 [ 979.991019] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.991019] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.991019] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.991019] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.991019] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.991019] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8c67e08f-d787-44cf-992a-7bb34d46c5e3 already deleted. [ 979.991019] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c67e08f-d787-44cf-992a-7bb34d46c5e3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.082220] env[62842]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] NSXv3 Agent Agent loop - iteration:1 completed [ 980.082220] env[62842]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] NSXv3 Agent Agent loop - iteration:2 started [ 980.093451] env[62842]: INFO networking_nsxv3.common.synchronization [req-bab942a6-c450-48e4-9437-24445e1128ac req-7edd9939-60c9-4b8c-8e2f-bfe714d3f98c service nova] Enqueued Resource ID: a28c97db-60c3-43e3-8413-1620ac6f1f6d with Priority: HIGHEST for action security_group_rules [ 980.093651] env[62842]: INFO networking_nsxv3.common.synchronization [req-bab942a6-c450-48e4-9437-24445e1128ac req-7edd9939-60c9-4b8c-8e2f-bfe714d3f98c service nova] Enqueued Resource ID: a28c97db-60c3-43e3-8413-1620ac6f1f6d with Priority: HIGHEST for action security_group_members [ 980.093791] env[62842]: INFO networking_nsxv3.common.synchronization [req-bab942a6-c450-48e4-9437-24445e1128ac req-7edd9939-60c9-4b8c-8e2f-bfe714d3f98c service nova] Enqueued Resource ID: 152c309b-7b9a-47fb-8f7f-b0b9c73a5440 with Priority: HIGHEST for action port [ 980.094025] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a28c97db-60c3-43e3-8413-1620ac6f1f6d with Priority: HIGHEST for action security_group_rules [ 980.094156] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a28c97db-60c3-43e3-8413-1620ac6f1f6d with Priority: HIGHEST for action security_group_members [ 980.094252] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 152c309b-7b9a-47fb-8f7f-b0b9c73a5440 with Priority: HIGHEST for action port [ 980.094780] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a28c97db-60c3-43e3-8413-1620ac6f1f6d taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.094901] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a28c97db-60c3-43e3-8413-1620ac6f1f6d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.094984] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a28c97db-60c3-43e3-8413-1620ac6f1f6d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.095204] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a28c97db-60c3-43e3-8413-1620ac6f1f6d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.095300] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a28c97db-60c3-43e3-8413-1620ac6f1f6d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.097725] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-a28c97db-60c3-43e3-8413-1620ac6f1f6d taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.097825] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a28c97db-60c3-43e3-8413-1620ac6f1f6d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.098027] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-152c309b-7b9a-47fb-8f7f-b0b9c73a5440 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.098130] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-152c309b-7b9a-47fb-8f7f-b0b9c73a5440" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.098192] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-152c309b-7b9a-47fb-8f7f-b0b9c73a5440" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.098369] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-152c309b-7b9a-47fb-8f7f-b0b9c73a5440" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.098444] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('152c309b-7b9a-47fb-8f7f-b0b9c73a5440',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.603562] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-a28c97db-60c3-43e3-8413-1620ac6f1f6d taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.603562] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a28c97db-60c3-43e3-8413-1620ac6f1f6d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.603562] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 152c309b-7b9a-47fb-8f7f-b0b9c73a5440 with status ACTIVE [ 980.603562] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.603562] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.603562] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.603562] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.603562] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.603562] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.603562] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.603562] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.604141] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.604141] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.604141] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.604248] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.604281] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.604818] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.604818] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.604818] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 152c309b-7b9a-47fb-8f7f-b0b9c73a5440 is going to be updated. [ 980.628996] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.629177] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.629233] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.629451] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.629589] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.629746] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-152c309b-7b9a-47fb-8f7f-b0b9c73a5440" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.779941] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a28c97db-60c3-43e3-8413-1620ac6f1f6d in Status: SUCCESS [ 980.780119] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a28c97db-60c3-43e3-8413-1620ac6f1f6d deletion is rescheduled due to dependency. [ 980.782509] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a28c97db-60c3-43e3-8413-1620ac6f1f6d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.782509] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a28c97db-60c3-43e3-8413-1620ac6f1f6d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.782509] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a28c97db-60c3-43e3-8413-1620ac6f1f6d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.782509] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.782509] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.782509] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.782509] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.782509] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.782509] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a28c97db-60c3-43e3-8413-1620ac6f1f6d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.959668] env[62842]: INFO networking_nsxv3.common.synchronization [None req-c20a4ac0-c037-4cb0-a81c-590729d3f8d0 None None] Enqueued Resource ID: 26f12cbe-64be-4f49-99ed-a16853720f11 with Priority: HIGHEST for action port [ 980.959764] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26f12cbe-64be-4f49-99ed-a16853720f11 with Priority: HIGHEST for action port [ 980.960477] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-26f12cbe-64be-4f49-99ed-a16853720f11 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.960586] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-26f12cbe-64be-4f49-99ed-a16853720f11" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.960586] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-26f12cbe-64be-4f49-99ed-a16853720f11" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.961267] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-26f12cbe-64be-4f49-99ed-a16853720f11" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.962360] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26f12cbe-64be-4f49-99ed-a16853720f11',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.286445] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a28c97db-60c3-43e3-8413-1620ac6f1f6d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.465404] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 26f12cbe-64be-4f49-99ed-a16853720f11 [ 981.465404] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.465634] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.465634] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.465785] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.466033] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.466033] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:26f12cbe-64be-4f49-99ed-a16853720f11 already deleted. [ 981.466033] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-26f12cbe-64be-4f49-99ed-a16853720f11" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.643374] env[62842]: INFO networking_nsxv3.common.synchronization [None req-f0fa0d14-634d-4690-8d2d-2adbaaede212 tempest-ServerRescueNegativeTestJSON-1880350091 tempest-ServerRescueNegativeTestJSON-1880350091-project-member] Enqueued Resource ID: 1744456a-cfb4-4022-aed6-d7e18e95179b with Priority: HIGHEST for action security_group_rules [ 981.643982] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1744456a-cfb4-4022-aed6-d7e18e95179b with Priority: HIGHEST for action security_group_rules [ 981.644372] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1744456a-cfb4-4022-aed6-d7e18e95179b taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.644496] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1744456a-cfb4-4022-aed6-d7e18e95179b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.644561] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1744456a-cfb4-4022-aed6-d7e18e95179b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.644821] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1744456a-cfb4-4022-aed6-d7e18e95179b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.644906] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1744456a-cfb4-4022-aed6-d7e18e95179b',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.736717] env[62842]: INFO networking_nsxv3.common.synchronization [None req-a0eb9601-675c-49ff-b512-82bfd792e88a tempest-ServerRescueNegativeTestJSON-1880350091 tempest-ServerRescueNegativeTestJSON-1880350091-project-member] Enqueued Resource ID: 1744456a-cfb4-4022-aed6-d7e18e95179b with Priority: HIGHEST for action security_group_rules [ 981.737478] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1744456a-cfb4-4022-aed6-d7e18e95179b with Priority: HIGHEST for action security_group_rules [ 981.737792] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1744456a-cfb4-4022-aed6-d7e18e95179b taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.737897] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1744456a-cfb4-4022-aed6-d7e18e95179b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.789184] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a28c97db-60c3-43e3-8413-1620ac6f1f6d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.170455] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.170682] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.170682] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.170892] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.171035] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.171174] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1744456a-cfb4-4022-aed6-d7e18e95179b already deleted. [ 982.171273] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1744456a-cfb4-4022-aed6-d7e18e95179b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.171403] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1744456a-cfb4-4022-aed6-d7e18e95179b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.171599] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1744456a-cfb4-4022-aed6-d7e18e95179b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.171688] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1744456a-cfb4-4022-aed6-d7e18e95179b',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.294811] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.295380] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.295380] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.295380] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.295380] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.297400] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a28c97db-60c3-43e3-8413-1620ac6f1f6d is going to be updated. [ 982.329661] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.329864] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.329864] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.332189] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.332189] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.340692] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a28c97db-60c3-43e3-8413-1620ac6f1f6d in Status: IN_PROGRESS for 2s [ 982.699591] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.699591] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.699591] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.699591] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.699591] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.699591] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1744456a-cfb4-4022-aed6-d7e18e95179b already deleted. [ 982.699591] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1744456a-cfb4-4022-aed6-d7e18e95179b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.338028] env[62842]: INFO networking_nsxv3.common.synchronization [None req-ac6d2245-9ab5-4b62-9b4c-f6ac6820e829 None None] Enqueued Resource ID: f7f90288-95dd-43ea-baa3-7787e25aa9ac with Priority: HIGHEST for action port [ 983.338028] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7f90288-95dd-43ea-baa3-7787e25aa9ac with Priority: HIGHEST for action port [ 983.338575] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-f7f90288-95dd-43ea-baa3-7787e25aa9ac taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.338575] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f7f90288-95dd-43ea-baa3-7787e25aa9ac" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.338575] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f7f90288-95dd-43ea-baa3-7787e25aa9ac" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.338874] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f7f90288-95dd-43ea-baa3-7787e25aa9ac" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.338874] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7f90288-95dd-43ea-baa3-7787e25aa9ac',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.384711] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-434 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.384711] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-434" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.384890] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-434" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.385407] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-434" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.385407] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.385990] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.385990] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.385990] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.386279] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.386357] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 983.386462] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 983.386580] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 983.387011] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 983.387011] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 983.387011] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 983.387151] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 983.407509] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 983.407741] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 983.407896] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 983.408115] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-434" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.408456] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-53541f34-c055-44ae-adfe-c9d41e13fb77 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.408625] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-53541f34-c055-44ae-adfe-c9d41e13fb77" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.408751] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-53541f34-c055-44ae-adfe-c9d41e13fb77" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.409053] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-53541f34-c055-44ae-adfe-c9d41e13fb77" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.409195] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53541f34-c055-44ae-adfe-c9d41e13fb77',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.841504] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f7f90288-95dd-43ea-baa3-7787e25aa9ac [ 983.841504] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.841664] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.841717] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.841947] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.842071] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.842159] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f7f90288-95dd-43ea-baa3-7787e25aa9ac already deleted. [ 983.842246] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f7f90288-95dd-43ea-baa3-7787e25aa9ac" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.911985] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.912313] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.912456] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.913048] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.913048] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.913214] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.913377] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.913500] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.913718] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.913863] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.914167] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.914331] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.914466] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.914683] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.914819] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.914963] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 53541f34-c055-44ae-adfe-c9d41e13fb77 is going to be updated. [ 983.936376] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.936598] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.936724] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.936991] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.937212] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.937439] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-53541f34-c055-44ae-adfe-c9d41e13fb77" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.351493] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a28c97db-60c3-43e3-8413-1620ac6f1f6d in Status: SUCCESS [ 984.352994] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a28c97db-60c3-43e3-8413-1620ac6f1f6d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.352994] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a28c97db-60c3-43e3-8413-1620ac6f1f6d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.352994] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a28c97db-60c3-43e3-8413-1620ac6f1f6d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.352994] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.352994] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.352994] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.353380] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.353380] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.353380] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a28c97db-60c3-43e3-8413-1620ac6f1f6d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.353488] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a28c97db-60c3-43e3-8413-1620ac6f1f6d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.780260] env[62842]: INFO networking_nsxv3.common.synchronization [req-df276854-1566-4dac-b473-dee1b642ce76 req-9c608621-3a77-4a49-8a5c-3604843fb71f service nova] Enqueued Resource ID: 15e06d0a-ad75-4e9d-b1a6-db54b2f524a4 with Priority: HIGHEST for action security_group_rules [ 984.780454] env[62842]: INFO networking_nsxv3.common.synchronization [req-df276854-1566-4dac-b473-dee1b642ce76 req-9c608621-3a77-4a49-8a5c-3604843fb71f service nova] Enqueued Resource ID: 15e06d0a-ad75-4e9d-b1a6-db54b2f524a4 with Priority: HIGHEST for action security_group_members [ 984.780596] env[62842]: INFO networking_nsxv3.common.synchronization [req-df276854-1566-4dac-b473-dee1b642ce76 req-9c608621-3a77-4a49-8a5c-3604843fb71f service nova] Enqueued Resource ID: 53541f34-c055-44ae-adfe-c9d41e13fb77 with Priority: HIGHEST for action port [ 984.780949] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15e06d0a-ad75-4e9d-b1a6-db54b2f524a4 with Priority: HIGHEST for action security_group_rules [ 984.781047] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15e06d0a-ad75-4e9d-b1a6-db54b2f524a4 with Priority: HIGHEST for action security_group_members [ 984.781138] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53541f34-c055-44ae-adfe-c9d41e13fb77 with Priority: HIGHEST for action port [ 984.781722] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.781805] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.781875] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.782353] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.782450] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15e06d0a-ad75-4e9d-b1a6-db54b2f524a4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.784572] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.784678] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.784743] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.784921] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.785115] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.785268] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.785408] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.785572] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.785661] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.785754] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15e06d0a-ad75-4e9d-b1a6-db54b2f524a4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.787999] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-53541f34-c055-44ae-adfe-c9d41e13fb77 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.788157] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-53541f34-c055-44ae-adfe-c9d41e13fb77" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.788239] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-53541f34-c055-44ae-adfe-c9d41e13fb77" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.788790] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-53541f34-c055-44ae-adfe-c9d41e13fb77" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.788790] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53541f34-c055-44ae-adfe-c9d41e13fb77',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.855890] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-a28c97db-60c3-43e3-8413-1620ac6f1f6d taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.856079] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a28c97db-60c3-43e3-8413-1620ac6f1f6d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.856129] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a28c97db-60c3-43e3-8413-1620ac6f1f6d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.856376] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a28c97db-60c3-43e3-8413-1620ac6f1f6d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.856555] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.856723] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.856815] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.857010] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.857129] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.857221] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a28c97db-60c3-43e3-8413-1620ac6f1f6d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.857399] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-a28c97db-60c3-43e3-8413-1620ac6f1f6d taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.857496] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a28c97db-60c3-43e3-8413-1620ac6f1f6d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.857614] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a28c97db-60c3-43e3-8413-1620ac6f1f6d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.857826] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a28c97db-60c3-43e3-8413-1620ac6f1f6d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.857983] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.858090] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.858168] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.858334] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.858412] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.858493] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a28c97db-60c3-43e3-8413-1620ac6f1f6d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.858589] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a28c97db-60c3-43e3-8413-1620ac6f1f6d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.285136] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.285272] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.290691] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15e06d0a-ad75-4e9d-b1a6-db54b2f524a4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.293119] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 53541f34-c055-44ae-adfe-c9d41e13fb77 with status ACTIVE [ 985.293119] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.293119] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.293343] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.293446] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.293538] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.293732] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.293833] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.293895] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.294063] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.294141] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.294370] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.294423] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.294459] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.294593] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.294664] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.294749] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 53541f34-c055-44ae-adfe-c9d41e13fb77 is going to be updated. [ 985.315997] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.315997] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.316126] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.316285] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.316426] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.316593] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-53541f34-c055-44ae-adfe-c9d41e13fb77" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.361049] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a28c97db-60c3-43e3-8413-1620ac6f1f6d: rpc.has_security_group_logging(os_id): False [ 985.381566] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.381749] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.381811] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.382060] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.382365] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.382696] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.382818] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.382893] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.383076] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.383187] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.383437] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.383553] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.383866] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.384515] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.384595] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.384829] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.384960] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.385016] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.385212] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.385283] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.385585] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a28c97db-60c3-43e3-8413-1620ac6f1f6d is going to be updated. [ 985.464228] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.464438] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.464438] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.464643] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.464793] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.480516] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a28c97db-60c3-43e3-8413-1620ac6f1f6d in Status: IN_PROGRESS for 2s [ 985.793888] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15e06d0a-ad75-4e9d-b1a6-db54b2f524a4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.932490] env[62842]: INFO networking_nsxv3.common.synchronization [req-6f82853e-32c3-40d1-8787-f473e745ec08 req-a25ba874-bc80-4799-9bee-7f0fd57324e2 tempest-AttachVolumeNegativeTest-1420230652 tempest-AttachVolumeNegativeTest-1420230652-project-member] Enqueued Resource ID: c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311 with Priority: HIGHEST for action security_group_members [ 985.933048] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311 with Priority: HIGHEST for action security_group_members [ 985.933417] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.933541] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.933598] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.933856] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.934027] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.934147] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.934350] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.934518] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.934605] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.934695] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.282604] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-468 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.282835] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-468" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.283049] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-468" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.283279] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-468" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.283623] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.283947] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.284115] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.284357] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.284555] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.284885] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 986.285147] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 986.285402] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 986.285655] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 986.285917] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 986.286194] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 986.286402] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 986.297562] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.297709] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.297755] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.297968] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.298066] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.298159] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15e06d0a-ad75-4e9d-b1a6-db54b2f524a4 is going to be updated. [ 986.307764] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 986.307764] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 986.307764] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 986.307764] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-468" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.308165] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-ada37106-a37a-4d1f-bcfb-1295d61aed34 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.308378] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-ada37106-a37a-4d1f-bcfb-1295d61aed34" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.310056] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-ada37106-a37a-4d1f-bcfb-1295d61aed34" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.310056] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-ada37106-a37a-4d1f-bcfb-1295d61aed34" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.310056] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ada37106-a37a-4d1f-bcfb-1295d61aed34',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.332669] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.332946] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.332946] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.333118] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.333264] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.345584] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15e06d0a-ad75-4e9d-b1a6-db54b2f524a4 in Status: IN_PROGRESS for 2s [ 986.436500] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.436799] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.436799] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.437058] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.437191] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.437428] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.437556] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.437639] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.437826] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.441167] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.441317] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311 already deleted. [ 986.441441] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.811798] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.812066] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.812219] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.812504] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.812664] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.812825] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port ada37106-a37a-4d1f-bcfb-1295d61aed34 not found, creating... [ 986.813105] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.813271] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.813399] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.813617] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.813760] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.814055] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.814220] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.814342] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.814623] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.814769] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.814913] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: ada37106-a37a-4d1f-bcfb-1295d61aed34 is going to be created. [ 986.835038] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.835330] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.835482] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.835768] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.836010] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.836251] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-ada37106-a37a-4d1f-bcfb-1295d61aed34" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.495933] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a28c97db-60c3-43e3-8413-1620ac6f1f6d in Status: SUCCESS [ 987.496293] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a28c97db-60c3-43e3-8413-1620ac6f1f6d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.743910] env[62842]: INFO networking_nsxv3.common.synchronization [req-6f82853e-32c3-40d1-8787-f473e745ec08 req-3055f82b-cddf-429f-b539-85ab491151bc service nova] Enqueued Resource ID: c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311 with Priority: HIGHEST for action security_group_rules [ 987.743910] env[62842]: INFO networking_nsxv3.common.synchronization [req-6f82853e-32c3-40d1-8787-f473e745ec08 req-3055f82b-cddf-429f-b539-85ab491151bc service nova] Enqueued Resource ID: c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311 with Priority: HIGHEST for action security_group_members [ 987.743910] env[62842]: INFO networking_nsxv3.common.synchronization [req-6f82853e-32c3-40d1-8787-f473e745ec08 req-3055f82b-cddf-429f-b539-85ab491151bc service nova] Enqueued Resource ID: ada37106-a37a-4d1f-bcfb-1295d61aed34 with Priority: HIGHEST for action port [ 987.743910] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311 with Priority: HIGHEST for action security_group_rules [ 987.743910] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311 with Priority: HIGHEST for action security_group_members [ 987.743910] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ada37106-a37a-4d1f-bcfb-1295d61aed34 with Priority: HIGHEST for action port [ 987.746210] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.746294] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.746294] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.746506] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.746591] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.747595] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.747723] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.747843] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.747955] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.748122] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.748219] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.748281] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.748422] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.748533] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.751714] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.756639] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-ada37106-a37a-4d1f-bcfb-1295d61aed34 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.756782] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ada37106-a37a-4d1f-bcfb-1295d61aed34" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.756832] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ada37106-a37a-4d1f-bcfb-1295d61aed34" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.757031] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ada37106-a37a-4d1f-bcfb-1295d61aed34" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.757108] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ada37106-a37a-4d1f-bcfb-1295d61aed34',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.105170] env[62842]: INFO networking_nsxv3.common.synchronization [None req-f11ec094-db22-4e7e-b8d3-b003827cb63f tempest-AttachVolumeTestJSON-43280943 tempest-AttachVolumeTestJSON-43280943-project-member] Enqueued Resource ID: 518e027d-4d1d-4cf5-a557-35f3eb956cd6 with Priority: HIGHEST for action security_group_rules [ 988.105170] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 518e027d-4d1d-4cf5-a557-35f3eb956cd6 with Priority: HIGHEST for action security_group_rules [ 988.105479] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-518e027d-4d1d-4cf5-a557-35f3eb956cd6 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.105746] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-518e027d-4d1d-4cf5-a557-35f3eb956cd6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.105918] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-518e027d-4d1d-4cf5-a557-35f3eb956cd6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.106274] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-518e027d-4d1d-4cf5-a557-35f3eb956cd6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.106461] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('518e027d-4d1d-4cf5-a557-35f3eb956cd6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.208619] env[62842]: INFO networking_nsxv3.common.synchronization [None req-4f6a91d8-34de-4940-8778-de85a6fa7d45 tempest-AttachVolumeTestJSON-43280943 tempest-AttachVolumeTestJSON-43280943-project-member] Enqueued Resource ID: 518e027d-4d1d-4cf5-a557-35f3eb956cd6 with Priority: HIGHEST for action security_group_rules [ 988.208944] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 518e027d-4d1d-4cf5-a557-35f3eb956cd6 with Priority: HIGHEST for action security_group_rules [ 988.209889] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-518e027d-4d1d-4cf5-a557-35f3eb956cd6 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.210162] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-518e027d-4d1d-4cf5-a557-35f3eb956cd6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.259657] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.260157] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.260411] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.261511] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ada37106-a37a-4d1f-bcfb-1295d61aed34 with status ACTIVE [ 988.261736] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.261874] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.261986] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.263510] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.263699] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.264033] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.264208] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.264312] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.264533] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.264895] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.264895] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.265046] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.265089] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.266992] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.266992] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.266992] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ada37106-a37a-4d1f-bcfb-1295d61aed34 is going to be updated. [ 988.292956] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.292956] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.292956] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.292956] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.292956] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.292956] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ada37106-a37a-4d1f-bcfb-1295d61aed34" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.363517] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15e06d0a-ad75-4e9d-b1a6-db54b2f524a4 in Status: SUCCESS [ 988.363517] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.363517] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.363517] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.363517] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.363517] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.363517] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.363517] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.363517] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.363517] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.363517] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('15e06d0a-ad75-4e9d-b1a6-db54b2f524a4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.627556] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.627939] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.627939] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.628027] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.628115] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.628180] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 518e027d-4d1d-4cf5-a557-35f3eb956cd6 already deleted. [ 988.628259] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-518e027d-4d1d-4cf5-a557-35f3eb956cd6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.628402] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-518e027d-4d1d-4cf5-a557-35f3eb956cd6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.628573] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-518e027d-4d1d-4cf5-a557-35f3eb956cd6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.628648] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('518e027d-4d1d-4cf5-a557-35f3eb956cd6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.768119] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.866040] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('15e06d0a-ad75-4e9d-b1a6-db54b2f524a4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.153501] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.153684] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.153763] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.153928] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.154027] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.154133] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 518e027d-4d1d-4cf5-a557-35f3eb956cd6 already deleted. [ 989.154218] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-518e027d-4d1d-4cf5-a557-35f3eb956cd6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.270779] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.270779] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.270956] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.271134] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.271227] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.271340] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311 is going to be created. [ 989.299283] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.299432] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.299484] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.299694] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.299855] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.309745] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311 in Status: UNINITIALIZED for 2s [ 989.368264] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 15e06d0a-ad75-4e9d-b1a6-db54b2f524a4: rpc.has_security_group_logging(os_id): False [ 989.387640] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.387819] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.387878] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.388197] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.388345] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.388661] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.388817] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.388953] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.389183] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.389341] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.389518] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15e06d0a-ad75-4e9d-b1a6-db54b2f524a4 is going to be updated. [ 989.456602] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.456815] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.456815] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.457024] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.457170] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.472397] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15e06d0a-ad75-4e9d-b1a6-db54b2f524a4 in Status: IN_PROGRESS for 2s [ 990.128526] env[62842]: INFO networking_nsxv3.common.synchronization [req-20396746-f7e8-4575-99ac-d6aa9eca94ba req-b29ef577-42fd-4c28-ae43-963147be3aa9 tempest-AttachInterfacesTestJSON-2140085841 tempest-AttachInterfacesTestJSON-2140085841-project-member] Enqueued Resource ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 with Priority: HIGHEST for action security_group_members [ 990.129276] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 with Priority: HIGHEST for action security_group_members [ 990.129604] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.129722] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.129783] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.129975] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.130138] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.130237] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.130761] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.130761] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.130761] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.130761] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77637a7d-8eb8-4f0e-a5bd-9870e0d191c6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.143792] env[62842]: INFO networking_nsxv3.common.synchronization [req-06f97b3f-72bb-4813-815e-0f2740133ac9 req-03b2cb79-608c-449f-ac36-09ec354f35a2 tempest-ServerActionsTestOtherA-1611322165 tempest-ServerActionsTestOtherA-1611322165-project-member] Enqueued Resource ID: a28c97db-60c3-43e3-8413-1620ac6f1f6d with Priority: HIGHEST for action security_group_members [ 990.144232] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a28c97db-60c3-43e3-8413-1620ac6f1f6d with Priority: HIGHEST for action security_group_members [ 990.144715] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-a28c97db-60c3-43e3-8413-1620ac6f1f6d taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.144943] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a28c97db-60c3-43e3-8413-1620ac6f1f6d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.144943] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a28c97db-60c3-43e3-8413-1620ac6f1f6d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.146165] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a28c97db-60c3-43e3-8413-1620ac6f1f6d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.146281] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.146411] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.146481] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.146647] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.146734] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.146829] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a28c97db-60c3-43e3-8413-1620ac6f1f6d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.185211] env[62842]: INFO networking_nsxv3.common.synchronization [req-06f97b3f-72bb-4813-815e-0f2740133ac9 req-03b2cb79-608c-449f-ac36-09ec354f35a2 tempest-ServerActionsTestOtherA-1611322165 tempest-ServerActionsTestOtherA-1611322165-project-member] Enqueued Resource ID: 152c309b-7b9a-47fb-8f7f-b0b9c73a5440 with Priority: HIGHEST for action port [ 990.185717] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 152c309b-7b9a-47fb-8f7f-b0b9c73a5440 with Priority: HIGHEST for action port [ 990.186095] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-152c309b-7b9a-47fb-8f7f-b0b9c73a5440 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.186168] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-152c309b-7b9a-47fb-8f7f-b0b9c73a5440" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.186216] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-152c309b-7b9a-47fb-8f7f-b0b9c73a5440" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.186424] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-152c309b-7b9a-47fb-8f7f-b0b9c73a5440" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.186505] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('152c309b-7b9a-47fb-8f7f-b0b9c73a5440',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.430288] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-416 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.430499] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-416" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.430625] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-416" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.430911] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-416" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.431260] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.431426] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.431596] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.431767] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.431930] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.432194] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 990.432313] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 990.432417] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 990.432525] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 990.432635] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 990.432741] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 990.432877] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 990.451890] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 990.452146] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 990.452258] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 990.453030] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-416" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.453030] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-bf0ebe2c-d274-45a0-8fd5-b165e9e67883 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.453317] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-bf0ebe2c-d274-45a0-8fd5-b165e9e67883" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.453529] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-bf0ebe2c-d274-45a0-8fd5-b165e9e67883" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.453866] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-bf0ebe2c-d274-45a0-8fd5-b165e9e67883" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.454243] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf0ebe2c-d274-45a0-8fd5-b165e9e67883',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.633201] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.633457] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.633525] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.633836] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.633940] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.634177] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.634301] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.634383] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.634538] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.634639] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.634752] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 is going to be updated. [ 990.648811] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.649046] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.649134] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.649418] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.649523] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.649742] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.649859] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.649941] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.650148] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.650275] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.650406] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a28c97db-60c3-43e3-8413-1620ac6f1f6d is going to be updated. [ 990.665074] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.665074] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.665074] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.665428] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.665428] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.676486] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 in Status: IN_PROGRESS for 2s [ 990.684832] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.685028] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.685117] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.685372] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.685497] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.688200] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 152c309b-7b9a-47fb-8f7f-b0b9c73a5440 with status ACTIVE [ 990.688387] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.688491] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.688577] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.688865] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.689061] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.689235] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.689343] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.689427] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.689625] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.689751] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.689942] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.690050] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.690112] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.690257] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.690331] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.690415] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 152c309b-7b9a-47fb-8f7f-b0b9c73a5440 is going to be updated. [ 990.698074] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a28c97db-60c3-43e3-8413-1620ac6f1f6d in Status: IN_PROGRESS for 2s [ 990.713465] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.713709] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.713783] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.714020] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.714161] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.714374] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-152c309b-7b9a-47fb-8f7f-b0b9c73a5440" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.956520] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.956796] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.956958] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.957271] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.957485] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.957703] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port bf0ebe2c-d274-45a0-8fd5-b165e9e67883 not found, creating... [ 990.961875] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.961875] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.961875] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.961875] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.961875] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.961875] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.961875] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.961875] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.961875] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.961875] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.962406] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: bf0ebe2c-d274-45a0-8fd5-b165e9e67883 is going to be created. [ 990.982406] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.982712] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.982875] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.983163] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.983437] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.984258] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-bf0ebe2c-d274-45a0-8fd5-b165e9e67883" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.320074] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311 in Status: SUCCESS [ 991.320074] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.320563] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.320563] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.320750] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.320912] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.320994] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.321242] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.321370] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.321491] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.321622] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.489334] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15e06d0a-ad75-4e9d-b1a6-db54b2f524a4 in Status: SUCCESS [ 991.489641] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.751865] env[62842]: INFO networking_nsxv3.common.synchronization [req-20396746-f7e8-4575-99ac-d6aa9eca94ba req-ccbfa02f-a0ca-496b-871f-7a3593149883 service nova] Enqueued Resource ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 with Priority: HIGHEST for action security_group_rules [ 991.751865] env[62842]: INFO networking_nsxv3.common.synchronization [req-20396746-f7e8-4575-99ac-d6aa9eca94ba req-ccbfa02f-a0ca-496b-871f-7a3593149883 service nova] Enqueued Resource ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 with Priority: HIGHEST for action security_group_members [ 991.751865] env[62842]: INFO networking_nsxv3.common.synchronization [req-20396746-f7e8-4575-99ac-d6aa9eca94ba req-ccbfa02f-a0ca-496b-871f-7a3593149883 service nova] Enqueued Resource ID: bf0ebe2c-d274-45a0-8fd5-b165e9e67883 with Priority: HIGHEST for action port [ 991.751865] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 with Priority: HIGHEST for action security_group_rules [ 991.751865] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 with Priority: HIGHEST for action security_group_members [ 991.751865] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf0ebe2c-d274-45a0-8fd5-b165e9e67883 with Priority: HIGHEST for action port [ 991.753026] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.753344] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.753994] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.753994] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.754276] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('77637a7d-8eb8-4f0e-a5bd-9870e0d191c6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.756186] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.756489] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.756914] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf0ebe2c-d274-45a0-8fd5-b165e9e67883 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.757201] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf0ebe2c-d274-45a0-8fd5-b165e9e67883" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.758056] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf0ebe2c-d274-45a0-8fd5-b165e9e67883" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.758056] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf0ebe2c-d274-45a0-8fd5-b165e9e67883" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.758056] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf0ebe2c-d274-45a0-8fd5-b165e9e67883',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.823983] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.260646] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.260646] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.260954] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bf0ebe2c-d274-45a0-8fd5-b165e9e67883 with status ACTIVE [ 992.261698] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.261698] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.261698] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.261698] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.261984] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.261984] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.262147] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.262186] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.262366] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.263047] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.263047] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.263047] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.263047] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.268724] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.268724] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.268724] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bf0ebe2c-d274-45a0-8fd5-b165e9e67883 is going to be updated. [ 992.291736] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.292025] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.292162] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.292441] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.292659] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.293078] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf0ebe2c-d274-45a0-8fd5-b165e9e67883" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.325788] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311: rpc.has_security_group_logging(os_id): False [ 992.344504] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.344870] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.345057] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.345366] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.345560] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.345907] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.346244] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.346403] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.346655] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.346825] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.347012] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311 is going to be created. [ 992.431424] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.431652] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.431722] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.431987] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.432228] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.451322] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311 in Status: IN_PROGRESS for 2s [ 992.796898] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 in Status: IN_PROGRESS for 4s [ 992.804549] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a28c97db-60c3-43e3-8413-1620ac6f1f6d in Status: SUCCESS [ 992.804549] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a28c97db-60c3-43e3-8413-1620ac6f1f6d deletion is rescheduled due to dependency. [ 992.804549] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a28c97db-60c3-43e3-8413-1620ac6f1f6d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.181655] env[62842]: INFO networking_nsxv3.common.synchronization [None req-d92e2e71-79a9-4392-8bf0-a33883813d73 tempest-ServerDiskConfigTestJSON-797549774 tempest-ServerDiskConfigTestJSON-797549774-project-member] Enqueued Resource ID: 710ade65-faa1-4ec7-80b1-05c5e1c5e8ed with Priority: HIGHEST for action security_group_rules [ 993.182444] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 710ade65-faa1-4ec7-80b1-05c5e1c5e8ed with Priority: HIGHEST for action security_group_rules [ 993.182813] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-710ade65-faa1-4ec7-80b1-05c5e1c5e8ed taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.182930] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-710ade65-faa1-4ec7-80b1-05c5e1c5e8ed" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.182995] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-710ade65-faa1-4ec7-80b1-05c5e1c5e8ed" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.183280] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-710ade65-faa1-4ec7-80b1-05c5e1c5e8ed" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.183365] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('710ade65-faa1-4ec7-80b1-05c5e1c5e8ed',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.313012] env[62842]: INFO networking_nsxv3.common.synchronization [None req-a1315254-ea46-48b8-b2a8-1ccaca00615e tempest-ServerDiskConfigTestJSON-797549774 tempest-ServerDiskConfigTestJSON-797549774-project-member] Enqueued Resource ID: 710ade65-faa1-4ec7-80b1-05c5e1c5e8ed with Priority: HIGHEST for action security_group_rules [ 993.314368] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 710ade65-faa1-4ec7-80b1-05c5e1c5e8ed with Priority: HIGHEST for action security_group_rules [ 993.314368] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-710ade65-faa1-4ec7-80b1-05c5e1c5e8ed taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.314368] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-710ade65-faa1-4ec7-80b1-05c5e1c5e8ed" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.708803] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.708803] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.708803] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.708803] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.708803] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.708803] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 710ade65-faa1-4ec7-80b1-05c5e1c5e8ed already deleted. [ 993.708803] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-710ade65-faa1-4ec7-80b1-05c5e1c5e8ed" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.708803] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-710ade65-faa1-4ec7-80b1-05c5e1c5e8ed" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.708803] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-710ade65-faa1-4ec7-80b1-05c5e1c5e8ed" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.708803] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('710ade65-faa1-4ec7-80b1-05c5e1c5e8ed',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.232587] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.232843] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.232912] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.233220] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.233420] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.233540] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 710ade65-faa1-4ec7-80b1-05c5e1c5e8ed already deleted. [ 994.233650] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-710ade65-faa1-4ec7-80b1-05c5e1c5e8ed" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.467965] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311 in Status: SUCCESS [ 994.468231] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.808895] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 in Status: SUCCESS [ 994.809441] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 deletion is rescheduled due to dependency. [ 994.809441] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.809441] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.809667] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.809822] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.809941] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.810033] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.810201] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.810277] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.810378] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77637a7d-8eb8-4f0e-a5bd-9870e0d191c6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.315516] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('77637a7d-8eb8-4f0e-a5bd-9870e0d191c6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.819570] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('77637a7d-8eb8-4f0e-a5bd-9870e0d191c6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.322479] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.322711] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.322777] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.323027] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.323158] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.323290] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 is going to be updated. [ 996.358825] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.358825] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.358825] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.358825] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.358825] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.371053] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 in Status: IN_PROGRESS for 2s [ 996.997594] env[62842]: INFO networking_nsxv3.common.synchronization [req-9d264963-b796-4779-bea5-9ca79ea4e649 req-2b5f635a-586c-4140-9f29-73c9c7b96780 tempest-ServerDiskConfigTestJSON-797549774 tempest-ServerDiskConfigTestJSON-797549774-project-member] Enqueued Resource ID: c184a589-476a-49bd-9984-d339a77ec8f3 with Priority: HIGHEST for action security_group_members [ 996.998295] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c184a589-476a-49bd-9984-d339a77ec8f3 with Priority: HIGHEST for action security_group_members [ 996.998595] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-c184a589-476a-49bd-9984-d339a77ec8f3 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.998719] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.998784] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.998981] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.999409] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.999557] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.999640] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.999893] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.999994] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.000123] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c184a589-476a-49bd-9984-d339a77ec8f3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.284341] env[62842]: INFO networking_nsxv3.common.synchronization [None req-2a625a2f-6fd4-49c7-8e37-622b312f7d0d tempest-AttachInterfacesTestJSON-2140085841 tempest-AttachInterfacesTestJSON-2140085841-project-member] Enqueued Resource ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 with Priority: HIGHEST for action security_group_members [ 997.284341] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 with Priority: HIGHEST for action security_group_members [ 997.284341] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.284341] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.504257] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.504257] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.504257] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.505092] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.505092] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.505092] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.508358] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.508516] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.508752] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.508857] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.508997] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c184a589-476a-49bd-9984-d339a77ec8f3 is going to be updated. [ 997.547868] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.548055] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.549544] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.550633] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.550731] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.564600] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c184a589-476a-49bd-9984-d339a77ec8f3 in Status: IN_PROGRESS for 2s [ 998.385953] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 in Status: SUCCESS [ 998.386960] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.386960] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.386960] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.386960] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.386960] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.387343] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.387343] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.387343] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.387463] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.387503] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('77637a7d-8eb8-4f0e-a5bd-9870e0d191c6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.388562] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.389437] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.389437] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.389437] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.389437] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.389437] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.389664] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.389664] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77637a7d-8eb8-4f0e-a5bd-9870e0d191c6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.895869] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.895869] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.895869] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('77637a7d-8eb8-4f0e-a5bd-9870e0d191c6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.400145] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('77637a7d-8eb8-4f0e-a5bd-9870e0d191c6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.574788] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c184a589-476a-49bd-9984-d339a77ec8f3 in Status: SUCCESS [ 999.574788] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c184a589-476a-49bd-9984-d339a77ec8f3 deletion is rescheduled due to dependency. [ 999.574788] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.903723] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.903723] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.903723] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.904481] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.904481] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.904481] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 is going to be updated. [ 999.958346] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.962026] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.962026] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.962026] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.962026] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.972605] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 in Status: IN_PROGRESS for 2s [ 1000.035650] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-416 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.035867] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-416" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.035999] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-416" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.036322] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-416" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.036608] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.036847] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.036988] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.038276] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.038504] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.038776] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1000.038948] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1000.039120] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1000.039269] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1000.039446] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1000.039591] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1000.039770] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1000.060797] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1000.061019] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1000.061240] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1000.061442] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-416" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.061780] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-65510a73-9187-461e-abb9-875050eed891 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.062096] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-65510a73-9187-461e-abb9-875050eed891" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.062200] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-65510a73-9187-461e-abb9-875050eed891" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.062504] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-65510a73-9187-461e-abb9-875050eed891" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.062652] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65510a73-9187-461e-abb9-875050eed891',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.179520] env[62842]: INFO networking_nsxv3.common.synchronization [None req-8b0e656b-0ad6-45c1-9d2a-ccc179bc32ed None None] Enqueued Resource ID: 1e168688-268f-4e78-b2df-3a1aa79d47d1 with Priority: HIGHEST for action port [ 1000.180243] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e168688-268f-4e78-b2df-3a1aa79d47d1 with Priority: HIGHEST for action port [ 1000.181486] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e168688-268f-4e78-b2df-3a1aa79d47d1 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.181486] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e168688-268f-4e78-b2df-3a1aa79d47d1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.181486] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e168688-268f-4e78-b2df-3a1aa79d47d1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.181486] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e168688-268f-4e78-b2df-3a1aa79d47d1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.181713] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e168688-268f-4e78-b2df-3a1aa79d47d1',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.568772] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.569228] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.569447] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.569752] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.569914] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.570091] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 65510a73-9187-461e-abb9-875050eed891 not found, creating... [ 1000.570368] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.570532] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.570651] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.570875] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.571034] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.571418] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.571584] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.571704] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.571917] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.572067] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.572287] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 65510a73-9187-461e-abb9-875050eed891 is going to be created. [ 1000.614053] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.614053] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.614053] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.615037] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.615037] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.615224] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-65510a73-9187-461e-abb9-875050eed891" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.685838] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1e168688-268f-4e78-b2df-3a1aa79d47d1 [ 1000.686955] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.686955] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.686955] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.686955] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.686955] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.686955] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1e168688-268f-4e78-b2df-3a1aa79d47d1 already deleted. [ 1000.686955] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e168688-268f-4e78-b2df-3a1aa79d47d1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.685413] env[62842]: INFO networking_nsxv3.common.synchronization [req-69bc5088-e26b-4377-81c5-2f1b41aed513 req-d59ade97-0c3c-4bf2-bb07-3b13b1622f88 tempest-ImagesTestJSON-1786483082 tempest-ImagesTestJSON-1786483082-project-member] Enqueued Resource ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 with Priority: HIGHEST for action security_group_members [ 1001.685887] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 with Priority: HIGHEST for action security_group_members [ 1001.687194] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e26630c-b3f7-4b48-9720-77b59135adf4 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.687194] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.687194] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.687867] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.687867] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.687867] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.687867] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.688466] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.688466] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.688466] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e26630c-b3f7-4b48-9720-77b59135adf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.691079] env[62842]: INFO networking_nsxv3.common.synchronization [req-c0f3b960-4738-4c37-aa36-777d40a14f57 req-940c7434-63fd-4f10-b736-ad80c0f88785 service nova] Enqueued Resource ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 with Priority: HIGHEST for action security_group_rules [ 1001.691308] env[62842]: INFO networking_nsxv3.common.synchronization [req-c0f3b960-4738-4c37-aa36-777d40a14f57 req-940c7434-63fd-4f10-b736-ad80c0f88785 service nova] Enqueued Resource ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 with Priority: HIGHEST for action security_group_members [ 1001.691452] env[62842]: INFO networking_nsxv3.common.synchronization [req-c0f3b960-4738-4c37-aa36-777d40a14f57 req-940c7434-63fd-4f10-b736-ad80c0f88785 service nova] Enqueued Resource ID: 65510a73-9187-461e-abb9-875050eed891 with Priority: HIGHEST for action port [ 1001.692101] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 with Priority: HIGHEST for action security_group_rules [ 1001.692303] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 with Priority: HIGHEST for action security_group_members [ 1001.692361] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65510a73-9187-461e-abb9-875050eed891 with Priority: HIGHEST for action port [ 1001.692600] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.692726] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.692873] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.692946] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.697764] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-65510a73-9187-461e-abb9-875050eed891 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.697764] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-65510a73-9187-461e-abb9-875050eed891" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.697764] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-65510a73-9187-461e-abb9-875050eed891" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.697764] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-65510a73-9187-461e-abb9-875050eed891" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.697764] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65510a73-9187-461e-abb9-875050eed891',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.985266] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 in Status: SUCCESS [ 1001.985513] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.985703] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.986025] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.986261] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.986390] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.986457] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.986636] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.986852] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.986946] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.987141] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.987227] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.987308] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.987423] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.987562] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.987657] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.987742] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.987855] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.987930] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.988021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.988111] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('77637a7d-8eb8-4f0e-a5bd-9870e0d191c6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.988938] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.989122] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.989273] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.989383] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.989449] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.989578] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.989676] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.989743] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77637a7d-8eb8-4f0e-a5bd-9870e0d191c6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.035398] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.035398] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.035398] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.035643] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.035643] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.135903] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-41 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.136128] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-41" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.136262] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-41" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.136609] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-41" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.136897] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.137069] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.137196] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.137427] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.137581] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.137798] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1002.137918] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1002.138043] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1002.138159] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1002.138279] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1002.138386] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1002.138527] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1002.160341] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1002.160522] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1002.161039] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1002.161039] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-41" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.161269] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-096b5032-8018-44b7-8e60-52ad950f4ac8 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.161441] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-096b5032-8018-44b7-8e60-52ad950f4ac8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.161568] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-096b5032-8018-44b7-8e60-52ad950f4ac8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.161908] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-096b5032-8018-44b7-8e60-52ad950f4ac8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.162070] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('096b5032-8018-44b7-8e60-52ad950f4ac8',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.193321] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.193483] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.193545] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.193757] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.193853] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.194589] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.194921] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.194921] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.195115] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.195220] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.195326] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 already deleted. [ 1002.195414] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.197844] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 65510a73-9187-461e-abb9-875050eed891 with status ACTIVE [ 1002.198043] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.198159] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.198241] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.198410] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.198616] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.198666] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.198749] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.198806] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.198945] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.199145] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.199298] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.199394] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.199456] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.199653] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.199653] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.199750] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 65510a73-9187-461e-abb9-875050eed891 is going to be updated. [ 1002.222634] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.222789] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.222888] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.223099] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.223263] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.223477] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-65510a73-9187-461e-abb9-875050eed891" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.491537] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6: rpc.has_security_group_logging(os_id): False [ 1002.495436] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('77637a7d-8eb8-4f0e-a5bd-9870e0d191c6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.505712] env[62842]: INFO networking_nsxv3.common.synchronization [None req-0bfc3e5f-90b9-4189-9ed6-8f633fe3939e None None] Enqueued Resource ID: 0ece2b40-61ed-40ce-b2a7-c4433e4041ee with Priority: HIGHEST for action port [ 1002.505976] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ece2b40-61ed-40ce-b2a7-c4433e4041ee with Priority: HIGHEST for action port [ 1002.506632] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ece2b40-61ed-40ce-b2a7-c4433e4041ee taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.506757] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ece2b40-61ed-40ce-b2a7-c4433e4041ee" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.506821] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ece2b40-61ed-40ce-b2a7-c4433e4041ee" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.507492] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ece2b40-61ed-40ce-b2a7-c4433e4041ee" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.507571] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ece2b40-61ed-40ce-b2a7-c4433e4041ee',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.511019] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.511296] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.511296] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.511597] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.511597] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.511761] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.511963] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.512051] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.512219] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.512299] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.512511] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.512603] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.512666] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.512810] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.512887] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.513768] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.514258] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.514311] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.514478] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.514565] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.514658] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 is going to be updated. [ 1002.541508] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.582594] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.582720] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.582799] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.582986] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.583146] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.599596] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 in Status: IN_PROGRESS for 2s [ 1002.665071] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.665326] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.665459] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.665757] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.665917] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.666088] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 096b5032-8018-44b7-8e60-52ad950f4ac8 not found, creating... [ 1002.666388] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.666558] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.666848] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.666908] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.667049] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.667361] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.667529] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.667652] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.668485] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.668485] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.668485] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 096b5032-8018-44b7-8e60-52ad950f4ac8 is going to be created. [ 1002.703723] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.704101] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.704101] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.704398] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.704766] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.705573] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-096b5032-8018-44b7-8e60-52ad950f4ac8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.997429] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('77637a7d-8eb8-4f0e-a5bd-9870e0d191c6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.009765] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0ece2b40-61ed-40ce-b2a7-c4433e4041ee [ 1003.010175] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.010175] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.010316] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.010427] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.010512] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.010607] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0ece2b40-61ed-40ce-b2a7-c4433e4041ee already deleted. [ 1003.010693] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ece2b40-61ed-40ce-b2a7-c4433e4041ee" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.044937] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.500614] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.500793] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.500838] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.501159] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.501287] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.501320] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 is going to be updated. [ 1003.532927] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.533114] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.533163] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.533396] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.533574] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.546016] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 in Status: IN_PROGRESS for 2s [ 1003.546185] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1003.546306] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1003.609380] env[62842]: INFO networking_nsxv3.common.synchronization [req-69bc5088-e26b-4377-81c5-2f1b41aed513 req-6ca3249a-a382-470a-a724-f3c07b7ff82d service nova] Enqueued Resource ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 with Priority: HIGHEST for action security_group_rules [ 1003.609658] env[62842]: INFO networking_nsxv3.common.synchronization [req-69bc5088-e26b-4377-81c5-2f1b41aed513 req-6ca3249a-a382-470a-a724-f3c07b7ff82d service nova] Enqueued Resource ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 with Priority: HIGHEST for action security_group_members [ 1003.609845] env[62842]: INFO networking_nsxv3.common.synchronization [req-69bc5088-e26b-4377-81c5-2f1b41aed513 req-6ca3249a-a382-470a-a724-f3c07b7ff82d service nova] Enqueued Resource ID: 096b5032-8018-44b7-8e60-52ad950f4ac8 with Priority: HIGHEST for action port [ 1003.610502] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 with Priority: HIGHEST for action security_group_rules [ 1003.610663] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 with Priority: HIGHEST for action security_group_members [ 1003.610798] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 096b5032-8018-44b7-8e60-52ad950f4ac8 with Priority: HIGHEST for action port [ 1003.612131] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e26630c-b3f7-4b48-9720-77b59135adf4 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.612377] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.612551] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.612959] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.613099] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e26630c-b3f7-4b48-9720-77b59135adf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.614575] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e26630c-b3f7-4b48-9720-77b59135adf4 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.614773] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.614892] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.615145] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.615420] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.615579] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.615681] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.615884] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.616058] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.616232] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e26630c-b3f7-4b48-9720-77b59135adf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.617286] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-096b5032-8018-44b7-8e60-52ad950f4ac8 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.617771] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-096b5032-8018-44b7-8e60-52ad950f4ac8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.617906] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-096b5032-8018-44b7-8e60-52ad950f4ac8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.618165] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-096b5032-8018-44b7-8e60-52ad950f4ac8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.618299] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('096b5032-8018-44b7-8e60-52ad950f4ac8',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.974297] env[62842]: INFO networking_nsxv3.common.synchronization [req-f89373e6-7a79-46cc-a81f-78bd3f86e5fc req-5871e675-affd-479f-bacc-194bca72bf0f tempest-MultipleCreateTestJSON-1704086459 tempest-MultipleCreateTestJSON-1704086459-project-member] Enqueued Resource ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 with Priority: HIGHEST for action security_group_members [ 1003.974915] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 with Priority: HIGHEST for action security_group_members [ 1003.975251] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-29a28398-6e5b-4a4f-81e9-a2f458468c19 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.975382] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.975445] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.975976] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.979524] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.979524] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.979524] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.979709] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.979709] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.979767] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29a28398-6e5b-4a4f-81e9-a2f458468c19',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.121576] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e26630c-b3f7-4b48-9720-77b59135adf4 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.121714] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.122506] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e26630c-b3f7-4b48-9720-77b59135adf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.122963] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 096b5032-8018-44b7-8e60-52ad950f4ac8 with status ACTIVE [ 1004.123192] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.123326] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.123417] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.123647] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.123780] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.123963] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.124089] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.124166] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.124377] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.124498] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.124715] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.124829] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.124893] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.125498] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.125637] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.125750] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 096b5032-8018-44b7-8e60-52ad950f4ac8 is going to be updated. [ 1004.152029] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.152282] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.152282] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.152487] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.152640] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.152822] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-096b5032-8018-44b7-8e60-52ad950f4ac8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.377029] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-180 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.377730] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-180" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.377730] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-180" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.378171] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-180" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.379033] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.379033] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.379033] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.379289] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.379480] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.379710] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1004.379843] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1004.379944] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1004.380072] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1004.380189] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1004.380300] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1004.380538] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1004.402150] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1004.402471] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1004.402696] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1004.402980] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-180" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.403497] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-d3fe2088-fdcd-4e7f-afd2-cc53163b55cd taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.410150] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-d3fe2088-fdcd-4e7f-afd2-cc53163b55cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.410150] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-d3fe2088-fdcd-4e7f-afd2-cc53163b55cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.410614] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-d3fe2088-fdcd-4e7f-afd2-cc53163b55cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.414019] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3fe2088-fdcd-4e7f-afd2-cc53163b55cd',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.483625] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.483625] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.483625] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.483625] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.483625] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.483988] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.483988] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.483988] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.484149] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.484149] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.484257] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 already deleted. [ 1004.484302] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.590657] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.590657] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.590657] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.590906] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.603327] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1004.604383] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.605755] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1004.624287] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 in Status: SUCCESS [ 1004.624591] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.624742] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.624963] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.625056] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('77637a7d-8eb8-4f0e-a5bd-9870e0d191c6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.627797] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e26630c-b3f7-4b48-9720-77b59135adf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.653015] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.653187] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.653243] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.653461] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.663850] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.664592] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1004.664674] env[62842]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=62842) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1004.664764] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1004.722239] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.722447] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.722495] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.722944] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.724321] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.724506] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1004.802858] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.804133] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.804133] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.804133] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.804133] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.804133] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1004.892031] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.893241] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.893319] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.893594] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.893889] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.894206] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:45. [ 1004.894309] env[62842]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'1ecbdf52-553d-43c4-b969-597ffc82c5d6', 'e1bf27f4-91cf-44a6-8115-e3876163a888', 'ae20759e-0e4f-4e29-8897-7eb813e03b32', '15e06d0a-ad75-4e9d-b1a6-db54b2f524a4', '77637a7d-8eb8-4f0e-a5bd-9870e0d191c6', '0a03224f-b75b-48a5-9e23-3ca50aabbb33', 'c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311', 'c184a589-476a-49bd-9984-d339a77ec8f3', '5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393', '82e532f4-b8b0-4a4a-affc-1ab5a63253cd', 'eb447582-c572-481b-befa-98a3dcf064c3', 'e90c0f27-4513-40eb-ba31-bf40f699d9a6', 'b47c6fcc-dd2d-4dd3-979a-610c0739cfd0', '437e64e0-ea9a-4d6f-88a7-838a0318993c', 'd1d35af8-d196-4dd3-b8df-9b98089c1606', '92cba5b3-76df-405c-acab-0f3155ce22e5', '38b4d382-6400-4588-b620-faecfba1fd64', '35146777-fd28-4ac7-b454-f7dd3fbb5846', '47118de8-4ba9-49a6-bc4b-d030be1e7c79', 'e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55', 'a14df1d2-b3a6-4075-b15b-967892c37b7e', 'c0ccbbde-9e94-45de-b00c-8f135b84465d', 'ea061614-3b2c-4a61-a74b-32a4b42f10a1', '331dd47d-e3b4-4338-b588-cd456a9aa5f7', 'bc98288b-6b97-448c-a5b8-54058cb0d341', '2d753783-8988-4639-a0fc-596bf03e413b', 'c59f85b7-500a-400b-bef3-55b5e589248f', '72454528-d410-48ed-92f0-27b44c9abb61', '3a595937-aa58-40f8-a3cf-b57a814011e8', '017b2ee9-30e5-4870-86c3-53c03de20d66', '102e4bfe-92ec-41e7-859f-253e7a405698', '16baecd6-bda3-40e1-98ef-4e238a3fc354', '074be4e0-ffc9-4ec9-b29a-40406844218c', 'd014d213-d805-403a-bcc9-8c66da8eefa2', '1648554a-7f11-49bf-b9b2-6edf888e2ce9', '1669144b-ae4c-489e-95db-13be5c3bfb22', 'e509406e-18a0-4842-8350-5830bdc3ec79', '534d1af9-5f3d-417d-8cb4-3116f2425761', '217e8514-093a-4d74-b378-a5091c69f5ba', 'e7acb0f4-6157-4a0c-977e-ee6a2808aa0e', '5704e4e3-8211-4e30-b474-06c668cf060d', 'a28c97db-60c3-43e3-8413-1620ac6f1f6d', '6588f3bb-b208-4ec7-8a50-1e573d683f24', 'cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37', '03708cfa-ea22-40d4-8c09-177242e076fa'} {{(pid=62842) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1004.894410] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1004.914117] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.914252] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.914323] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.914552] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.914637] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.914749] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1004.914820] env[62842]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=62842) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1004.914890] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1004.916411] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.916672] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.916801] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.917051] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.917199] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.917350] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port d3fe2088-fdcd-4e7f-afd2-cc53163b55cd not found, creating... [ 1004.917605] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.917761] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.917878] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.918101] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.918240] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.918647] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.918814] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.918934] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.919173] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.919328] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.919779] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: d3fe2088-fdcd-4e7f-afd2-cc53163b55cd is going to be created. [ 1004.941267] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.941476] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.941610] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.941886] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.942150] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.942424] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-d3fe2088-fdcd-4e7f-afd2-cc53163b55cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.039026] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.039026] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.039388] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.039512] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.040966] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.041442] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1005.041551] env[62842]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=62842) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1005.041655] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1005.041731] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1005.041811] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/45 resources of Type:Security Group Rules [ 1005.041885] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1ecbdf52-553d-43c4-b969-597ffc82c5d6 with Priority: HIGH for action security_group_rules [ 1005.041970] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e1bf27f4-91cf-44a6-8115-e3876163a888 with Priority: HIGH for action security_group_rules [ 1005.042050] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ae20759e-0e4f-4e29-8897-7eb813e03b32 with Priority: HIGH for action security_group_rules [ 1005.042168] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 15e06d0a-ad75-4e9d-b1a6-db54b2f524a4 with Priority: HIGH for action security_group_rules [ 1005.042262] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 with Priority: HIGH for action security_group_rules [ 1005.042294] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 with Priority: HIGH for action security_group_rules [ 1005.042376] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311 with Priority: HIGH for action security_group_rules [ 1005.042441] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c184a589-476a-49bd-9984-d339a77ec8f3 with Priority: HIGH for action security_group_rules [ 1005.042626] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 with Priority: HIGH for action security_group_rules [ 1005.042626] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd with Priority: HIGH for action security_group_rules [ 1005.042626] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: eb447582-c572-481b-befa-98a3dcf064c3 with Priority: HIGH for action security_group_rules [ 1005.042797] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 with Priority: HIGH for action security_group_rules [ 1005.042797] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b47c6fcc-dd2d-4dd3-979a-610c0739cfd0 with Priority: HIGH for action security_group_rules [ 1005.042797] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 437e64e0-ea9a-4d6f-88a7-838a0318993c with Priority: HIGH for action security_group_rules [ 1005.042882] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d1d35af8-d196-4dd3-b8df-9b98089c1606 with Priority: HIGH for action security_group_rules [ 1005.042912] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 92cba5b3-76df-405c-acab-0f3155ce22e5 with Priority: HIGH for action security_group_rules [ 1005.042950] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 38b4d382-6400-4588-b620-faecfba1fd64 with Priority: HIGH for action security_group_rules [ 1005.043049] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 with Priority: HIGH for action security_group_rules [ 1005.043120] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 47118de8-4ba9-49a6-bc4b-d030be1e7c79 with Priority: HIGH for action security_group_rules [ 1005.043287] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55 with Priority: HIGH for action security_group_rules [ 1005.043437] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.127415] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.127551] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.131930] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.131930] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.131930] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.131930] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.131930] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.131930] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 is going to be created. [ 1005.157752] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.157947] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.157947] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.158236] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.158398] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.172064] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 in Status: UNINITIALIZED for 2s [ 1005.557412] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 in Status: SUCCESS [ 1005.557631] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.557830] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.558061] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.558334] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.558476] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.558476] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.559020] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.559020] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.559020] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.559020] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('77637a7d-8eb8-4f0e-a5bd-9870e0d191c6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.725921] env[62842]: INFO networking_nsxv3.common.synchronization [req-f89373e6-7a79-46cc-a81f-78bd3f86e5fc req-49969186-8b69-4ef9-96ac-07edf3536b39 service nova] Enqueued Resource ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 with Priority: HIGHEST for action security_group_rules [ 1005.726123] env[62842]: INFO networking_nsxv3.common.synchronization [req-f89373e6-7a79-46cc-a81f-78bd3f86e5fc req-49969186-8b69-4ef9-96ac-07edf3536b39 service nova] Enqueued Resource ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 with Priority: HIGHEST for action security_group_members [ 1005.726266] env[62842]: INFO networking_nsxv3.common.synchronization [req-f89373e6-7a79-46cc-a81f-78bd3f86e5fc req-49969186-8b69-4ef9-96ac-07edf3536b39 service nova] Enqueued Resource ID: d3fe2088-fdcd-4e7f-afd2-cc53163b55cd with Priority: HIGHEST for action port [ 1005.726824] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 with Priority: HIGHEST for action security_group_rules [ 1005.726977] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 with Priority: HIGHEST for action security_group_members [ 1005.727235] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3fe2088-fdcd-4e7f-afd2-cc53163b55cd with Priority: HIGHEST for action port [ 1005.727354] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ecbdf52-553d-43c4-b969-597ffc82c5d6 with Priority: HIGH for action security_group_rules [ 1005.727450] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae20759e-0e4f-4e29-8897-7eb813e03b32 with Priority: HIGH for action security_group_rules [ 1005.727544] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311 with Priority: HIGH for action security_group_rules [ 1005.727633] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1d35af8-d196-4dd3-b8df-9b98089c1606 with Priority: HIGH for action security_group_rules [ 1005.727755] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55 with Priority: HIGH for action security_group_rules [ 1005.727828] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47118de8-4ba9-49a6-bc4b-d030be1e7c79 with Priority: HIGH for action security_group_rules [ 1005.727889] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 with Priority: HIGH for action security_group_rules [ 1005.727973] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38b4d382-6400-4588-b620-faecfba1fd64 with Priority: HIGH for action security_group_rules [ 1005.728072] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 437e64e0-ea9a-4d6f-88a7-838a0318993c with Priority: HIGH for action security_group_rules [ 1005.728162] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92cba5b3-76df-405c-acab-0f3155ce22e5 with Priority: HIGH for action security_group_rules [ 1005.728281] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b47c6fcc-dd2d-4dd3-979a-610c0739cfd0 with Priority: HIGH for action security_group_rules [ 1005.728416] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 with Priority: HIGH for action security_group_rules [ 1005.728499] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb447582-c572-481b-befa-98a3dcf064c3 with Priority: HIGH for action security_group_rules [ 1005.728589] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd with Priority: HIGH for action security_group_rules [ 1005.728676] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 with Priority: HIGH for action security_group_rules [ 1005.728756] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 with Priority: HIGH for action security_group_rules [ 1005.728837] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c184a589-476a-49bd-9984-d339a77ec8f3 with Priority: HIGH for action security_group_rules [ 1005.728916] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 with Priority: HIGH for action security_group_rules [ 1005.731066] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1bf27f4-91cf-44a6-8115-e3876163a888 with Priority: HIGH for action security_group_rules [ 1005.731066] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15e06d0a-ad75-4e9d-b1a6-db54b2f524a4 with Priority: HIGH for action security_group_rules [ 1005.731066] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-29a28398-6e5b-4a4f-81e9-a2f458468c19 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.731066] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.731066] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.731066] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.731066] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('29a28398-6e5b-4a4f-81e9-a2f458468c19',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.731430] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-29a28398-6e5b-4a4f-81e9-a2f458468c19 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.731641] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.731641] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.731827] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.731995] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.732108] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.732177] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.732333] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.733122] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.733122] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29a28398-6e5b-4a4f-81e9-a2f458468c19',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.736041] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-d3fe2088-fdcd-4e7f-afd2-cc53163b55cd taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.736041] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d3fe2088-fdcd-4e7f-afd2-cc53163b55cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.736041] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d3fe2088-fdcd-4e7f-afd2-cc53163b55cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.736041] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d3fe2088-fdcd-4e7f-afd2-cc53163b55cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.736041] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3fe2088-fdcd-4e7f-afd2-cc53163b55cd',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.736041] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ecbdf52-553d-43c4-b969-597ffc82c5d6 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.736041] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ecbdf52-553d-43c4-b969-597ffc82c5d6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.736041] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ecbdf52-553d-43c4-b969-597ffc82c5d6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.736041] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ecbdf52-553d-43c4-b969-597ffc82c5d6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.736041] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ecbdf52-553d-43c4-b969-597ffc82c5d6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.736041] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae20759e-0e4f-4e29-8897-7eb813e03b32 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.736041] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae20759e-0e4f-4e29-8897-7eb813e03b32" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.736041] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae20759e-0e4f-4e29-8897-7eb813e03b32" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.736776] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae20759e-0e4f-4e29-8897-7eb813e03b32" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.736776] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae20759e-0e4f-4e29-8897-7eb813e03b32',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.737540] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.737540] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.737653] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.737833] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.737906] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.738736] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1d35af8-d196-4dd3-b8df-9b98089c1606 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.738903] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1d35af8-d196-4dd3-b8df-9b98089c1606" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.738903] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1d35af8-d196-4dd3-b8df-9b98089c1606" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.739141] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1d35af8-d196-4dd3-b8df-9b98089c1606" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.739224] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1d35af8-d196-4dd3-b8df-9b98089c1606',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.739931] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.740088] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.740162] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.741274] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.741274] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.741274] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47118de8-4ba9-49a6-bc4b-d030be1e7c79 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.741472] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.741472] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.742312] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.742312] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47118de8-4ba9-49a6-bc4b-d030be1e7c79',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.742514] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-35146777-fd28-4ac7-b454-f7dd3fbb5846 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.742622] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.742687] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.742838] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.742908] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('35146777-fd28-4ac7-b454-f7dd3fbb5846',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.743606] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-38b4d382-6400-4588-b620-faecfba1fd64 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.743713] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.743778] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.744289] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.744978] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('38b4d382-6400-4588-b620-faecfba1fd64',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.745687] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-437e64e0-ea9a-4d6f-88a7-838a0318993c taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.745797] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-437e64e0-ea9a-4d6f-88a7-838a0318993c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.745867] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-437e64e0-ea9a-4d6f-88a7-838a0318993c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.746032] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-437e64e0-ea9a-4d6f-88a7-838a0318993c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.746106] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('437e64e0-ea9a-4d6f-88a7-838a0318993c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.746813] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-92cba5b3-76df-405c-acab-0f3155ce22e5 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.747187] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-92cba5b3-76df-405c-acab-0f3155ce22e5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.747187] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-92cba5b3-76df-405c-acab-0f3155ce22e5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.753793] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-92cba5b3-76df-405c-acab-0f3155ce22e5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.753793] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('92cba5b3-76df-405c-acab-0f3155ce22e5',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.753793] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.753793] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.753793] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.753793] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.753793] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b47c6fcc-dd2d-4dd3-979a-610c0739cfd0',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.753793] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e90c0f27-4513-40eb-ba31-bf40f699d9a6 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.753793] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.754468] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.754468] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.754468] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e90c0f27-4513-40eb-ba31-bf40f699d9a6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.754839] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb447582-c572-481b-befa-98a3dcf064c3 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.754995] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb447582-c572-481b-befa-98a3dcf064c3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.756923] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb447582-c572-481b-befa-98a3dcf064c3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.756923] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb447582-c572-481b-befa-98a3dcf064c3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.756923] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb447582-c572-481b-befa-98a3dcf064c3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.756923] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-82e532f4-b8b0-4a4a-affc-1ab5a63253cd taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.756923] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.757166] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.757166] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.757232] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('82e532f4-b8b0-4a4a-affc-1ab5a63253cd',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.758295] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.758397] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.758462] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.758612] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.758698] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.759414] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a03224f-b75b-48a5-9e23-3ca50aabbb33 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.759519] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.759587] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.759736] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.759810] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a03224f-b75b-48a5-9e23-3ca50aabbb33',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.760618] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c184a589-476a-49bd-9984-d339a77ec8f3 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.763018] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.763018] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.763018] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.763018] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c184a589-476a-49bd-9984-d339a77ec8f3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.763018] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.763018] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.763018] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e1bf27f4-91cf-44a6-8115-e3876163a888 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.763018] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.763018] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.763018] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.763018] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e1bf27f4-91cf-44a6-8115-e3876163a888',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.763666] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.763666] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.763666] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.763666] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.763666] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15e06d0a-ad75-4e9d-b1a6-db54b2f524a4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.061674] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.061972] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.061972] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.062215] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.062408] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.062515] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.062592] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.062761] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.062853] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.062942] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.063132] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.063231] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.063295] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.063461] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.063657] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.063762] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.063840] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.064044] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.064136] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.064219] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.064345] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('77637a7d-8eb8-4f0e-a5bd-9870e0d191c6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.266366] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.266487] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.266564] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.266794] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.266963] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.267076] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.267178] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.267298] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.267417] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.267469] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.267560] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.270723] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d3fe2088-fdcd-4e7f-afd2-cc53163b55cd with status ACTIVE [ 1006.270910] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.271039] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.271069] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.271257] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.271352] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.271510] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.271602] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.271661] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.271800] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.271874] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.272295] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.272295] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.272295] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.272439] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.272468] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.272537] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d3fe2088-fdcd-4e7f-afd2-cc53163b55cd is going to be updated. [ 1006.273475] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae20759e-0e4f-4e29-8897-7eb813e03b32 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.273586] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae20759e-0e4f-4e29-8897-7eb813e03b32" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.273653] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae20759e-0e4f-4e29-8897-7eb813e03b32" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.273796] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae20759e-0e4f-4e29-8897-7eb813e03b32" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.273930] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.274093] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.274093] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.274221] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.274321] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.274362] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae20759e-0e4f-4e29-8897-7eb813e03b32" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.274495] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ae20759e-0e4f-4e29-8897-7eb813e03b32',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.282024] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.282024] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.282024] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.282024] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.282024] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.282024] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.282024] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.282024] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.282024] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.282024] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.282024] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.287600] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('29a28398-6e5b-4a4f-81e9-a2f458468c19',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.288513] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-29a28398-6e5b-4a4f-81e9-a2f458468c19 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.288641] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.290796] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.290909] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.290977] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.291200] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.291378] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.291492] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.291535] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.291683] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.291759] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.291841] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.291921] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('15e06d0a-ad75-4e9d-b1a6-db54b2f524a4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.301186] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.358429] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.358661] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.358714] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.358897] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.360725] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.360895] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.362159] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.362338] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.363682] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.363780] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.366858] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.366977] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.367866] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.368662] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.368718] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.368818] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.369524] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.369627] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.370335] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.370472] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.371416] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.371416] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.371908] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.372058] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.375739] env[62842]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1006.375739] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.375739] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.375739] env[62842]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1006.375739] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.375739] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.375739] env[62842]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1006.375739] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.376183] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.376941] env[62842]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1006.376941] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.376941] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.382599] env[62842]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1006.385817] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.385817] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.385817] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.385817] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.385817] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.385817] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d3fe2088-fdcd-4e7f-afd2-cc53163b55cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.385817] env[62842]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1006.385817] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.385817] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb447582-c572-481b-befa-98a3dcf064c3 is going to be deleted. [ 1006.386315] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.386513] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.411085] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.411374] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1d35af8-d196-4dd3-b8df-9b98089c1606 is going to be deleted. [ 1006.412255] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.412521] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.446418] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.446418] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 92cba5b3-76df-405c-acab-0f3155ce22e5 is going to be deleted. [ 1006.446887] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.447137] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.480805] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.480805] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.481193] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.481322] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 82e532f4-b8b0-4a4a-affc-1ab5a63253cd is going to be deleted. [ 1006.482447] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.482698] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.534866] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.534866] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e90c0f27-4513-40eb-ba31-bf40f699d9a6 is going to be deleted. [ 1006.534866] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.534866] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.558856] env[62842]: INFO networking_nsxv3.common.synchronization [req-f89373e6-7a79-46cc-a81f-78bd3f86e5fc req-978ebcb4-0ee3-4194-9fb3-cfa5a6f142f8 tempest-MultipleCreateTestJSON-1704086459 tempest-MultipleCreateTestJSON-1704086459-project-member] Enqueued Resource ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 with Priority: HIGHEST for action security_group_members [ 1006.561448] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 with Priority: HIGHEST for action security_group_members [ 1006.562077] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-29a28398-6e5b-4a4f-81e9-a2f458468c19 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.562741] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.568482] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6: rpc.has_security_group_logging(os_id): False [ 1006.592769] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.592769] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.605484] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.605484] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47118de8-4ba9-49a6-bc4b-d030be1e7c79 is going to be deleted. [ 1006.606932] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.607253] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.633648] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.633648] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.655265] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.655479] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 is going to be deleted. [ 1006.658035] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.658035] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.658035] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.658035] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.659930] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.659930] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.676198] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.676352] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.747999] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.747999] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.747999] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.747999] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.747999] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.747999] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.748331] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.748331] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.748394] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.748497] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.748567] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.748756] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.748829] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.748886] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.749045] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.749190] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.749261] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 is going to be updated. [ 1006.750326] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.750491] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.771462] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.771637] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.777999] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.778097] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ae20759e-0e4f-4e29-8897-7eb813e03b32',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.796749] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('29a28398-6e5b-4a4f-81e9-a2f458468c19',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.800331] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('15e06d0a-ad75-4e9d-b1a6-db54b2f524a4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.810359] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393: rpc.has_security_group_logging(os_id): False [ 1006.823546] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.823546] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.848155] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.849311] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 is going to be deleted. [ 1006.851120] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.851398] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.904208] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.904208] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.925024] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.925024] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b47c6fcc-dd2d-4dd3-979a-610c0739cfd0 is going to be deleted. [ 1006.925024] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.925024] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.951139] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.951139] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.980568] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.980568] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c184a589-476a-49bd-9984-d339a77ec8f3 is going to be deleted. [ 1006.981875] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.982048] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.982048] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.982314] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.982356] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.982452] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.982593] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.982769] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.018323] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.018646] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 38b4d382-6400-4588-b620-faecfba1fd64 is going to be deleted. [ 1007.020020] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.024250] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.024337] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.024556] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.024664] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.024774] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b47c6fcc-dd2d-4dd3-979a-610c0739cfd0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.024927] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.025096] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.081385] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.081627] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 437e64e0-ea9a-4d6f-88a7-838a0318993c is going to be deleted. [ 1007.082905] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.083151] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.083248] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.083381] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1d35af8-d196-4dd3-b8df-9b98089c1606" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.083606] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.083823] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.084118] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.084182] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-92cba5b3-76df-405c-acab-0f3155ce22e5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.084843] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.085017] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.098841] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.098975] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.156517] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-180 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.156699] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-180" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.156880] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-180" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.157227] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-180" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.157627] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.157886] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.158091] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.158333] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.158527] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.159029] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1007.159029] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1007.159183] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1007.159421] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1007.159488] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1007.159570] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1007.159732] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1007.177217] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.177385] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ecbdf52-553d-43c4-b969-597ffc82c5d6 is going to be deleted. [ 1007.178937] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.178937] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.179117] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.179509] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e90c0f27-4513-40eb-ba31-bf40f699d9a6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.179509] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.179596] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.179634] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.179753] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-82e532f4-b8b0-4a4a-affc-1ab5a63253cd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.180381] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.180691] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.184460] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.184627] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.193773] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 in Status: SUCCESS [ 1007.193976] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.194158] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.194413] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.194638] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.194762] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.194846] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.194999] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.195097] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.195184] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.195276] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3e26630c-b3f7-4b48-9720-77b59135adf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.197832] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1007.198012] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.038 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1007.198160] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1007.198327] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-180" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.198695] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-09f31858-0828-42c0-a716-a444eeb47032 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.198876] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-09f31858-0828-42c0-a716-a444eeb47032" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.199007] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-09f31858-0828-42c0-a716-a444eeb47032" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.199479] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-09f31858-0828-42c0-a716-a444eeb47032" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.199628] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09f31858-0828-42c0-a716-a444eeb47032',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.212371] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.212538] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.236563] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.236708] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55 is going to be deleted. [ 1007.237653] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.237895] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.238015] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.238159] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47118de8-4ba9-49a6-bc4b-d030be1e7c79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.238332] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.238511] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.238606] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.238739] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.239345] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.239514] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.279660] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311: rpc.has_security_group_logging(os_id): False [ 1007.285911] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ae20759e-0e4f-4e29-8897-7eb813e03b32: rpc.has_security_group_logging(os_id): False [ 1007.299218] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.299423] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.299515] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.299755] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.299848] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.299950] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 is going to be created. [ 1007.301774] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.301874] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.303595] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 15e06d0a-ad75-4e9d-b1a6-db54b2f524a4: rpc.has_security_group_logging(os_id): False [ 1007.305630] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.305902] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.305998] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.306079] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.306270] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.306355] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.306448] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 is going to be updated. [ 1007.307404] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.307577] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.307719] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.308576] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.308743] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.353419] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.353863] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.370019] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.370291] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.396490] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.396645] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.401245] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.401419] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e1bf27f4-91cf-44a6-8115-e3876163a888 is going to be deleted. [ 1007.402539] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.402764] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.402867] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.403049] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.403231] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.403434] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.403526] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.403706] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-38b4d382-6400-4588-b620-faecfba1fd64" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.405174] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.405322] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.405405] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.405640] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.405814] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.406922] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.407121] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.407266] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.407489] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-437e64e0-ea9a-4d6f-88a7-838a0318993c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.407656] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.407814] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.407986] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.408045] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ecbdf52-553d-43c4-b969-597ffc82c5d6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.408617] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.408817] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.409568] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.409568] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb447582-c572-481b-befa-98a3dcf064c3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.409568] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.409568] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.413760] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 in Status: IN_PROGRESS for 2s [ 1007.443938] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 in Status: UNINITIALIZED for 2s [ 1007.481313] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.481502] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.484635] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.484936] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.485341] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.485341] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.485341] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.485436] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.486433] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311 is going to be updated. [ 1007.486587] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.487070] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.516256] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.516517] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.548206] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.548724] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.549818] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.549818] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.549818] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.549818] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.549818] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15e06d0a-ad75-4e9d-b1a6-db54b2f524a4 is going to be updated. [ 1007.551513] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.551651] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.551715] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.552745] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.552946] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.598474] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 in Status: IN_PROGRESS for 2s [ 1007.605370] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.605370] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.605370] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.605370] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.605370] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.605370] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.605370] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.605370] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.605370] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae20759e-0e4f-4e29-8897-7eb813e03b32 is going to be updated. [ 1007.606743] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.607051] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.607214] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.607406] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e768bb5c-8a71-4aa6-8a07-fa8ad9a0ff55" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.607604] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.607823] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.607968] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.608184] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e1bf27f4-91cf-44a6-8115-e3876163a888" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.683101] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.683101] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.683101] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.683387] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.683608] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.697271] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e26630c-b3f7-4b48-9720-77b59135adf4 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.697456] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.697539] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.697693] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.697859] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.697958] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.698029] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.698201] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.698312] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.698540] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.698711] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e26630c-b3f7-4b48-9720-77b59135adf4 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.698827] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.698916] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.699131] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.699292] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.699410] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.699509] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.699673] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.699776] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.699883] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.699976] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3e26630c-b3f7-4b48-9720-77b59135adf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.702040] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.702228] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.702391] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.702782] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.702912] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.703115] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 09f31858-0828-42c0-a716-a444eeb47032 not found, creating... [ 1007.703435] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.703625] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.703779] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.704076] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.704251] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.704596] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.704790] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.705168] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.705228] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.705360] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.705521] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 09f31858-0828-42c0-a716-a444eeb47032 is going to be created. [ 1007.709610] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311 in Status: IN_PROGRESS for 2s [ 1007.807999] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.807999] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.808318] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.808663] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.809034] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.809381] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-09f31858-0828-42c0-a716-a444eeb47032" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.830975] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.831173] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.831689] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.831689] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.831689] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.854419] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.854419] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.854419] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.854774] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.854774] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.885123] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15e06d0a-ad75-4e9d-b1a6-db54b2f524a4 in Status: IN_PROGRESS for 2s [ 1007.911908] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae20759e-0e4f-4e29-8897-7eb813e03b32 in Status: IN_PROGRESS for 2s [ 1008.208654] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3e26630c-b3f7-4b48-9720-77b59135adf4: rpc.has_security_group_logging(os_id): False [ 1008.230248] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.230436] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.230474] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.230690] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.231141] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.231447] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.231572] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.231619] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.231782] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.231862] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.232099] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.232211] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.232403] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.232500] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.232793] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.233010] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.233116] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.233180] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.233328] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.233426] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.233530] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 is going to be created. [ 1008.304195] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.307739] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.307864] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.308290] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.308691] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.322355] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 in Status: IN_PROGRESS for 2s [ 1008.917647] env[62842]: INFO networking_nsxv3.common.synchronization [req-f89373e6-7a79-46cc-a81f-78bd3f86e5fc req-5281f2ce-50a5-49d2-9eee-3ba134d2822e service nova] Enqueued Resource ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 with Priority: HIGHEST for action security_group_rules [ 1008.917851] env[62842]: INFO networking_nsxv3.common.synchronization [req-f89373e6-7a79-46cc-a81f-78bd3f86e5fc req-5281f2ce-50a5-49d2-9eee-3ba134d2822e service nova] Enqueued Resource ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 with Priority: HIGHEST for action security_group_members [ 1008.918546] env[62842]: INFO networking_nsxv3.common.synchronization [req-f89373e6-7a79-46cc-a81f-78bd3f86e5fc req-5281f2ce-50a5-49d2-9eee-3ba134d2822e service nova] Enqueued Resource ID: 09f31858-0828-42c0-a716-a444eeb47032 with Priority: HIGHEST for action port [ 1008.918887] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 with Priority: HIGHEST for action security_group_rules [ 1008.919260] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 with Priority: HIGHEST for action security_group_members [ 1008.919390] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09f31858-0828-42c0-a716-a444eeb47032 with Priority: HIGHEST for action port [ 1008.919692] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-29a28398-6e5b-4a4f-81e9-a2f458468c19 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.919794] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.920085] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-29a28398-6e5b-4a4f-81e9-a2f458468c19 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.920150] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.920323] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-09f31858-0828-42c0-a716-a444eeb47032 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.920465] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-09f31858-0828-42c0-a716-a444eeb47032" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.920497] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-09f31858-0828-42c0-a716-a444eeb47032" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.920702] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-09f31858-0828-42c0-a716-a444eeb47032" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.920781] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09f31858-0828-42c0-a716-a444eeb47032',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.181943] env[62842]: INFO networking_nsxv3.common.synchronization [req-f6a9a247-3ef1-4620-aa9b-a396453ab124 req-c55639c3-9a29-4dd4-b152-2cc563c95553 tempest-ServerRescueNegativeTestJSON-1880350091 tempest-ServerRescueNegativeTestJSON-1880350091-project-member] Enqueued Resource ID: 1744456a-cfb4-4022-aed6-d7e18e95179b with Priority: HIGHEST for action security_group_members [ 1009.182797] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1744456a-cfb4-4022-aed6-d7e18e95179b with Priority: HIGHEST for action security_group_members [ 1009.183121] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-1744456a-cfb4-4022-aed6-d7e18e95179b taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.183243] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1744456a-cfb4-4022-aed6-d7e18e95179b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.183303] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1744456a-cfb4-4022-aed6-d7e18e95179b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.183643] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1744456a-cfb4-4022-aed6-d7e18e95179b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.184098] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.184217] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.184280] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.184448] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.184533] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.184783] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1744456a-cfb4-4022-aed6-d7e18e95179b',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.423207] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 09f31858-0828-42c0-a716-a444eeb47032 with status ACTIVE [ 1009.423570] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.423731] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.423822] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.424058] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.424153] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.424350] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.424450] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.424510] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.424662] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.424735] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.424918] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.425023] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.425087] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.425225] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.425310] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.425448] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 09f31858-0828-42c0-a716-a444eeb47032 is going to be updated. [ 1009.437291] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 in Status: SUCCESS [ 1009.437575] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.437775] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.438092] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.438250] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('77637a7d-8eb8-4f0e-a5bd-9870e0d191c6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.459409] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.459555] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.459636] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.459840] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.460034] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.460493] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-09f31858-0828-42c0-a716-a444eeb47032" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.461162] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 in Status: SUCCESS [ 1009.461937] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.461937] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.461937] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.461937] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.462136] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.462136] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.462311] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.462358] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.462435] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.462531] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('29a28398-6e5b-4a4f-81e9-a2f458468c19',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.463700] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.463830] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.463974] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.464099] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.464149] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.464288] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.464787] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.464787] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29a28398-6e5b-4a4f-81e9-a2f458468c19',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.532247] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-243 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.532478] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-243" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.532598] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-243" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.532870] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-243" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.533444] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.533444] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.533444] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.533923] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.533923] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.534022] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1009.534145] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1009.534829] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1009.534953] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1009.535180] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1009.535239] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1009.535354] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1009.563907] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1009.564182] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1009.564276] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1009.564436] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-243" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.564783] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-c714ef21-afe8-4399-a8e1-71688393fe74 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.564978] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-c714ef21-afe8-4399-a8e1-71688393fe74" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.565118] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-c714ef21-afe8-4399-a8e1-71688393fe74" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.565465] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-c714ef21-afe8-4399-a8e1-71688393fe74" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.566146] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c714ef21-afe8-4399-a8e1-71688393fe74',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.615352] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 in Status: SUCCESS [ 1009.615352] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.687393] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.687629] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.687747] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.688068] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.688222] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.688481] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.688632] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.688739] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.688981] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.689122] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.689293] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1744456a-cfb4-4022-aed6-d7e18e95179b already deleted. [ 1009.689399] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1744456a-cfb4-4022-aed6-d7e18e95179b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.722941] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311 in Status: SUCCESS [ 1009.723207] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.902831] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15e06d0a-ad75-4e9d-b1a6-db54b2f524a4 in Status: SUCCESS [ 1009.902831] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.926070] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae20759e-0e4f-4e29-8897-7eb813e03b32 in Status: SUCCESS [ 1009.926472] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae20759e-0e4f-4e29-8897-7eb813e03b32" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.940188] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.940453] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.940453] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.940644] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.940839] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.940952] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.941029] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.941246] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.941337] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.941438] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.941716] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('77637a7d-8eb8-4f0e-a5bd-9870e0d191c6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.966512] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-29a28398-6e5b-4a4f-81e9-a2f458468c19 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.966735] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.967140] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('29a28398-6e5b-4a4f-81e9-a2f458468c19',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.067968] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.069430] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.069430] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.069695] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.069854] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.070032] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port c714ef21-afe8-4399-a8e1-71688393fe74 not found, creating... [ 1010.070340] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.070520] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.070645] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.070875] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.071032] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.071389] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.071559] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.071683] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.071901] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.072246] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.072429] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: c714ef21-afe8-4399-a8e1-71688393fe74 is going to be created. [ 1010.101718] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.101718] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.101718] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.101955] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.102218] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.102469] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-c714ef21-afe8-4399-a8e1-71688393fe74" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.337913] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 in Status: SUCCESS [ 1010.338197] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.444940] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.444940] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.444940] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.445399] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.445399] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.445399] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.445489] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.446515] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.446515] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.446515] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.446515] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.446515] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.446515] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.446515] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.446515] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.446515] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.446515] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.446945] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.446945] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.446945] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.446945] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('77637a7d-8eb8-4f0e-a5bd-9870e0d191c6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.469057] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('29a28398-6e5b-4a4f-81e9-a2f458468c19',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.897245] env[62842]: INFO networking_nsxv3.common.synchronization [req-f6a9a247-3ef1-4620-aa9b-a396453ab124 req-2a8c9e1a-912d-4412-b344-83fb243b9136 service nova] Enqueued Resource ID: 1744456a-cfb4-4022-aed6-d7e18e95179b with Priority: HIGHEST for action security_group_rules [ 1010.897432] env[62842]: INFO networking_nsxv3.common.synchronization [req-f6a9a247-3ef1-4620-aa9b-a396453ab124 req-2a8c9e1a-912d-4412-b344-83fb243b9136 service nova] Enqueued Resource ID: 1744456a-cfb4-4022-aed6-d7e18e95179b with Priority: HIGHEST for action security_group_members [ 1010.897588] env[62842]: INFO networking_nsxv3.common.synchronization [req-f6a9a247-3ef1-4620-aa9b-a396453ab124 req-2a8c9e1a-912d-4412-b344-83fb243b9136 service nova] Enqueued Resource ID: c714ef21-afe8-4399-a8e1-71688393fe74 with Priority: HIGHEST for action port [ 1010.898192] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1744456a-cfb4-4022-aed6-d7e18e95179b with Priority: HIGHEST for action security_group_rules [ 1010.898329] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1744456a-cfb4-4022-aed6-d7e18e95179b with Priority: HIGHEST for action security_group_members [ 1010.898441] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c714ef21-afe8-4399-a8e1-71688393fe74 with Priority: HIGHEST for action port [ 1010.898780] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1744456a-cfb4-4022-aed6-d7e18e95179b taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.898972] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1744456a-cfb4-4022-aed6-d7e18e95179b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.898972] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1744456a-cfb4-4022-aed6-d7e18e95179b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.899371] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1744456a-cfb4-4022-aed6-d7e18e95179b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.899456] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1744456a-cfb4-4022-aed6-d7e18e95179b',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.902164] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-1744456a-cfb4-4022-aed6-d7e18e95179b taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.902164] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1744456a-cfb4-4022-aed6-d7e18e95179b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.902164] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1744456a-cfb4-4022-aed6-d7e18e95179b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.902164] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1744456a-cfb4-4022-aed6-d7e18e95179b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.902164] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.902164] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.902164] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.902386] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.902386] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.902386] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1744456a-cfb4-4022-aed6-d7e18e95179b',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.903770] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-c714ef21-afe8-4399-a8e1-71688393fe74 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.903770] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c714ef21-afe8-4399-a8e1-71688393fe74" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.903770] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c714ef21-afe8-4399-a8e1-71688393fe74" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.903929] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c714ef21-afe8-4399-a8e1-71688393fe74" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.903987] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c714ef21-afe8-4399-a8e1-71688393fe74',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.949268] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6: rpc.has_security_group_logging(os_id): False [ 1010.969861] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.970114] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.970190] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.970368] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.970460] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.970663] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.970769] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.970863] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.970959] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.971039] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.971354] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.971476] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.971538] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.971686] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.971759] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.971995] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.972219] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.972291] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.972456] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.972547] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.972639] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 is going to be updated. [ 1010.974294] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.974401] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.974469] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.974618] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.974696] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.974785] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 is going to be updated. [ 1011.018699] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.018927] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.019057] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.019356] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.019572] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.031082] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 in Status: IN_PROGRESS for 2s [ 1011.056461] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.056595] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.056663] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.056897] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.058025] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.081258] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 in Status: IN_PROGRESS for 2s [ 1011.403589] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-1744456a-cfb4-4022-aed6-d7e18e95179b taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.403589] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1744456a-cfb4-4022-aed6-d7e18e95179b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.404279] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1744456a-cfb4-4022-aed6-d7e18e95179b',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.408720] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c714ef21-afe8-4399-a8e1-71688393fe74 with status ACTIVE [ 1011.408996] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.409227] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.409227] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.410376] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.410515] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.410771] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.410866] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.410980] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.411252] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.411348] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.411627] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.411846] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.411934] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.415326] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.415421] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.415495] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c714ef21-afe8-4399-a8e1-71688393fe74 is going to be updated. [ 1011.441547] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.441764] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.441764] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.442110] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.442110] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.442349] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c714ef21-afe8-4399-a8e1-71688393fe74" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.911027] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1744456a-cfb4-4022-aed6-d7e18e95179b',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.412504] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.412739] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.412739] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.413024] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.413144] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.413236] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1744456a-cfb4-4022-aed6-d7e18e95179b is going to be created. [ 1012.514373] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.514508] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.514580] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.514799] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.514958] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.525540] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1744456a-cfb4-4022-aed6-d7e18e95179b in Status: UNINITIALIZED for 2s [ 1013.045036] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 in Status: SUCCESS [ 1013.045362] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.045362] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.045499] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.047191] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.047191] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.047191] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.047191] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.047191] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.047191] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29a28398-6e5b-4a4f-81e9-a2f458468c19',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.105147] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 in Status: SUCCESS [ 1013.105704] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.551379] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('29a28398-6e5b-4a4f-81e9-a2f458468c19',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.051019] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('29a28398-6e5b-4a4f-81e9-a2f458468c19',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.457138] env[62842]: INFO networking_nsxv3.common.synchronization [req-9d085c69-b7de-4f32-9062-0a7a3b5b58d2 req-18cdcb27-97c0-49cb-b352-26084ded2026 tempest-AttachInterfacesTestJSON-2140085841 tempest-AttachInterfacesTestJSON-2140085841-project-member] Enqueued Resource ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 with Priority: HIGHEST for action security_group_members [ 1014.457680] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 with Priority: HIGHEST for action security_group_members [ 1014.457984] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.458115] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.458181] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.458382] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.458537] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.458635] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.458709] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.459037] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.459037] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.460097] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77637a7d-8eb8-4f0e-a5bd-9870e0d191c6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.537656] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1744456a-cfb4-4022-aed6-d7e18e95179b in Status: SUCCESS [ 1014.537734] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1744456a-cfb4-4022-aed6-d7e18e95179b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.538260] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1744456a-cfb4-4022-aed6-d7e18e95179b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.538260] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1744456a-cfb4-4022-aed6-d7e18e95179b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.538260] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.538425] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.538459] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.538621] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.538680] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.538739] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1744456a-cfb4-4022-aed6-d7e18e95179b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.538830] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1744456a-cfb4-4022-aed6-d7e18e95179b',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.554349] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.554495] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.554564] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.554766] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.554853] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.554949] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 is going to be updated. [ 1014.583108] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.583108] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.583108] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.583233] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.583377] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.593707] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 in Status: IN_PROGRESS for 2s [ 1014.964288] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('77637a7d-8eb8-4f0e-a5bd-9870e0d191c6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.995681] env[62842]: INFO networking_nsxv3.common.synchronization [None req-79bd09ff-f63b-4968-b9ea-6381187a8661 tempest-AttachInterfacesTestJSON-2140085841 tempest-AttachInterfacesTestJSON-2140085841-project-member] Enqueued Resource ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 with Priority: HIGHEST for action security_group_members [ 1014.996405] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 with Priority: HIGHEST for action security_group_members [ 1014.996713] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.996815] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.044224] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1744456a-cfb4-4022-aed6-d7e18e95179b',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.466520] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('77637a7d-8eb8-4f0e-a5bd-9870e0d191c6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.546890] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1744456a-cfb4-4022-aed6-d7e18e95179b: rpc.has_security_group_logging(os_id): False [ 1015.570936] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.571131] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.571131] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.571503] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.571598] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.571855] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.571971] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.572044] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.572223] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.572297] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.572395] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1744456a-cfb4-4022-aed6-d7e18e95179b is going to be created. [ 1015.647194] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.647406] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.647495] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.649060] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.649060] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.662702] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1744456a-cfb4-4022-aed6-d7e18e95179b in Status: IN_PROGRESS for 2s [ 1015.969640] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.969815] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.969873] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.970146] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.970937] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.970937] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 is going to be updated. [ 1016.001288] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.001517] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.001589] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.001887] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.001949] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.011725] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 in Status: IN_PROGRESS for 2s [ 1016.573475] env[62842]: INFO networking_nsxv3.common.synchronization [req-c96411fe-7865-4e84-a0c6-727a89a4e8c7 req-c1b469e1-59af-4dd1-ba62-0ff6b06e1a9a tempest-AttachVolumeTestJSON-43280943 tempest-AttachVolumeTestJSON-43280943-project-member] Enqueued Resource ID: 518e027d-4d1d-4cf5-a557-35f3eb956cd6 with Priority: HIGHEST for action security_group_members [ 1016.574279] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 518e027d-4d1d-4cf5-a557-35f3eb956cd6 with Priority: HIGHEST for action security_group_members [ 1016.575030] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-518e027d-4d1d-4cf5-a557-35f3eb956cd6 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.575030] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-518e027d-4d1d-4cf5-a557-35f3eb956cd6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.575030] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-518e027d-4d1d-4cf5-a557-35f3eb956cd6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.575301] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-518e027d-4d1d-4cf5-a557-35f3eb956cd6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.575412] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.575521] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.575589] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.576197] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.576299] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.576485] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('518e027d-4d1d-4cf5-a557-35f3eb956cd6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.607669] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 in Status: SUCCESS [ 1016.607669] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.607669] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.607888] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.608154] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.608304] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.608304] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.608435] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.608765] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.608765] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.608765] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-29a28398-6e5b-4a4f-81e9-a2f458468c19 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.608972] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.608972] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.609071] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.609154] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.609246] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.609306] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.609437] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.609511] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.609580] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.609672] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('29a28398-6e5b-4a4f-81e9-a2f458468c19',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.990975] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-435 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.991179] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-435" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.991357] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-435" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.991642] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-435" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.991907] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.992090] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.992244] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.992489] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.992664] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.992867] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1016.992981] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1016.993101] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1016.993292] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1016.993345] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1016.993422] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1016.993596] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1017.014408] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1017.014627] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1017.014829] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1017.014905] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-435" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.015408] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-027ddaa6-7539-4358-bf7e-b44c42029823 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.015408] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-027ddaa6-7539-4358-bf7e-b44c42029823" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.015607] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-027ddaa6-7539-4358-bf7e-b44c42029823" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.015870] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-027ddaa6-7539-4358-bf7e-b44c42029823" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.016033] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('027ddaa6-7539-4358-bf7e-b44c42029823',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.079294] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.079521] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.079521] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.079754] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.079847] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.080055] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.080147] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.080199] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.080355] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.080423] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.080512] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 518e027d-4d1d-4cf5-a557-35f3eb956cd6 already deleted. [ 1017.080612] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-518e027d-4d1d-4cf5-a557-35f3eb956cd6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.112786] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 29a28398-6e5b-4a4f-81e9-a2f458468c19: rpc.has_security_group_logging(os_id): False [ 1017.130451] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.130602] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.130659] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.130919] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.131017] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.131197] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.131346] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.131411] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.131561] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.131638] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.131834] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.131927] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.131989] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.132140] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.132244] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.132429] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.132523] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.132584] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.132721] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.132794] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.132878] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 is going to be created. [ 1017.203700] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.203700] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.203700] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.203908] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.204036] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.215686] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 in Status: IN_PROGRESS for 2s [ 1017.519146] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.519426] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.519586] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.519841] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.519994] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.520169] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 027ddaa6-7539-4358-bf7e-b44c42029823 not found, creating... [ 1017.522024] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.522306] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.522451] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.522958] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.522958] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.523312] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.523582] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.523738] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.524032] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.524403] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.524633] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 027ddaa6-7539-4358-bf7e-b44c42029823 is going to be created. [ 1017.551024] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.551024] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.551024] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.551024] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.551024] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.551024] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-027ddaa6-7539-4358-bf7e-b44c42029823" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.690831] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1744456a-cfb4-4022-aed6-d7e18e95179b in Status: SUCCESS [ 1017.690831] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1744456a-cfb4-4022-aed6-d7e18e95179b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.023896] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 in Status: SUCCESS [ 1018.024280] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.024444] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.024740] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.024990] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.025163] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.025263] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.025486] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.025603] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.025894] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77637a7d-8eb8-4f0e-a5bd-9870e0d191c6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.351905] env[62842]: INFO networking_nsxv3.common.synchronization [req-c96411fe-7865-4e84-a0c6-727a89a4e8c7 req-7df4d9ab-9324-4043-9301-100588bb93cd service nova] Enqueued Resource ID: 518e027d-4d1d-4cf5-a557-35f3eb956cd6 with Priority: HIGHEST for action security_group_rules [ 1018.352131] env[62842]: INFO networking_nsxv3.common.synchronization [req-c96411fe-7865-4e84-a0c6-727a89a4e8c7 req-7df4d9ab-9324-4043-9301-100588bb93cd service nova] Enqueued Resource ID: 518e027d-4d1d-4cf5-a557-35f3eb956cd6 with Priority: HIGHEST for action security_group_members [ 1018.352284] env[62842]: INFO networking_nsxv3.common.synchronization [req-c96411fe-7865-4e84-a0c6-727a89a4e8c7 req-7df4d9ab-9324-4043-9301-100588bb93cd service nova] Enqueued Resource ID: 027ddaa6-7539-4358-bf7e-b44c42029823 with Priority: HIGHEST for action port [ 1018.352893] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 518e027d-4d1d-4cf5-a557-35f3eb956cd6 with Priority: HIGHEST for action security_group_rules [ 1018.353076] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 518e027d-4d1d-4cf5-a557-35f3eb956cd6 with Priority: HIGHEST for action security_group_members [ 1018.353183] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 027ddaa6-7539-4358-bf7e-b44c42029823 with Priority: HIGHEST for action port [ 1018.353480] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-518e027d-4d1d-4cf5-a557-35f3eb956cd6 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.353609] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-518e027d-4d1d-4cf5-a557-35f3eb956cd6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.353665] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-518e027d-4d1d-4cf5-a557-35f3eb956cd6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.353878] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-518e027d-4d1d-4cf5-a557-35f3eb956cd6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.353959] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('518e027d-4d1d-4cf5-a557-35f3eb956cd6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.355015] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-518e027d-4d1d-4cf5-a557-35f3eb956cd6 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.355146] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-518e027d-4d1d-4cf5-a557-35f3eb956cd6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.355254] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-518e027d-4d1d-4cf5-a557-35f3eb956cd6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.355400] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-518e027d-4d1d-4cf5-a557-35f3eb956cd6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.355565] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.355659] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.355713] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.355847] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.356099] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.356198] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('518e027d-4d1d-4cf5-a557-35f3eb956cd6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.358470] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-027ddaa6-7539-4358-bf7e-b44c42029823 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.358579] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-027ddaa6-7539-4358-bf7e-b44c42029823" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.358579] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-027ddaa6-7539-4358-bf7e-b44c42029823" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.358723] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-027ddaa6-7539-4358-bf7e-b44c42029823" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.358801] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('027ddaa6-7539-4358-bf7e-b44c42029823',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.528342] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.528576] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.528695] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.528943] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.529077] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.529311] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.529413] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.529489] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.529670] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.529782] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.529868] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 is going to be updated. [ 1018.558539] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.558689] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.558759] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.558960] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.559119] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.573301] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 in Status: IN_PROGRESS for 2s [ 1018.860446] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('518e027d-4d1d-4cf5-a557-35f3eb956cd6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.860768] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-518e027d-4d1d-4cf5-a557-35f3eb956cd6 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.860768] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-518e027d-4d1d-4cf5-a557-35f3eb956cd6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.861863] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 027ddaa6-7539-4358-bf7e-b44c42029823 with status ACTIVE [ 1018.861863] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.861863] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.861863] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.862105] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.862105] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.863157] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.863157] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.863157] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.863157] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.863157] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.863157] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.863157] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.863157] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.863514] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.863592] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.863710] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 027ddaa6-7539-4358-bf7e-b44c42029823 is going to be updated. [ 1018.888021] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.888021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.888021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.888021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.888021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.888021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-027ddaa6-7539-4358-bf7e-b44c42029823" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.941335] env[62842]: INFO networking_nsxv3.common.synchronization [req-07e3ded1-800f-4a2c-9569-f51b4bf14b49 req-9f8299ed-3c75-4888-8383-4fb0fdad5b44 tempest-ServersTestJSON-1267616671 tempest-ServersTestJSON-1267616671-project-member] Enqueued Resource ID: 074be4e0-ffc9-4ec9-b29a-40406844218c with Priority: HIGHEST for action security_group_members [ 1018.941914] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 074be4e0-ffc9-4ec9-b29a-40406844218c with Priority: HIGHEST for action security_group_members [ 1018.942322] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-074be4e0-ffc9-4ec9-b29a-40406844218c taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.942518] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.942622] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.942863] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.943069] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.943230] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.943328] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.943521] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.943690] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.943844] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.301135] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 in Status: SUCCESS [ 1019.301412] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.301603] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.301822] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.301908] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('29a28398-6e5b-4a4f-81e9-a2f458468c19',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.362474] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('518e027d-4d1d-4cf5-a557-35f3eb956cd6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.420148] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-509 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.420438] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-509" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.420604] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-509" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.420888] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-509" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.421176] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.424994] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.424994] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.424994] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.424994] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.424994] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1019.424994] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1019.424994] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1019.424994] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1019.424994] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1019.424994] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1019.424994] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1019.446609] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1019.446609] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1019.446609] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1019.446609] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-509" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.446609] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-0a0dc132-3c57-4d3e-8f17-c88e3bf67ede taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.447022] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-0a0dc132-3c57-4d3e-8f17-c88e3bf67ede" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.447022] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-0a0dc132-3c57-4d3e-8f17-c88e3bf67ede" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.447397] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-0a0dc132-3c57-4d3e-8f17-c88e3bf67ede" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.447546] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a0dc132-3c57-4d3e-8f17-c88e3bf67ede',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.448629] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.807476] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-29a28398-6e5b-4a4f-81e9-a2f458468c19 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.807650] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.807811] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.807945] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.808126] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.808220] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.808280] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.808528] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.808636] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.808751] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.808861] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('29a28398-6e5b-4a4f-81e9-a2f458468c19',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.865835] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.865835] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.865835] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.866253] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.866253] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.866475] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 518e027d-4d1d-4cf5-a557-35f3eb956cd6 is going to be created. [ 1019.892687] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.892687] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.892687] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.892687] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.893015] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.904934] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 518e027d-4d1d-4cf5-a557-35f3eb956cd6 in Status: UNINITIALIZED for 2s [ 1019.950361] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.950667] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.950819] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.951120] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.951345] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.951548] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 0a0dc132-3c57-4d3e-8f17-c88e3bf67ede not found, creating... [ 1019.951817] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.952067] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.952259] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.952605] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.952782] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.953085] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.953250] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.953376] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.953598] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.953732] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.953878] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 0a0dc132-3c57-4d3e-8f17-c88e3bf67ede is going to be created. [ 1019.954972] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.977091] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.977388] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.977546] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.978272] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.978560] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.978818] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-0a0dc132-3c57-4d3e-8f17-c88e3bf67ede" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.311713] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-29a28398-6e5b-4a4f-81e9-a2f458468c19 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.311933] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.312063] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.312295] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.312541] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.312670] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.312767] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.312968] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.313098] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.313213] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.313416] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-29a28398-6e5b-4a4f-81e9-a2f458468c19 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.313538] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.313645] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.313850] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.314045] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.314172] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.314227] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.314363] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.314488] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.314591] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.314692] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('29a28398-6e5b-4a4f-81e9-a2f458468c19',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.457635] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.458458] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.458458] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.458860] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.458925] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.459141] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 074be4e0-ffc9-4ec9-b29a-40406844218c is going to be updated. [ 1020.496769] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.496923] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.496982] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.497227] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.497381] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.510161] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 074be4e0-ffc9-4ec9-b29a-40406844218c in Status: IN_PROGRESS for 2s [ 1020.584845] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 in Status: SUCCESS [ 1020.585180] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 deletion is rescheduled due to dependency. [ 1020.585363] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.817120] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 29a28398-6e5b-4a4f-81e9-a2f458468c19: rpc.has_security_group_logging(os_id): False [ 1020.841977] env[62842]: INFO networking_nsxv3.common.synchronization [req-07e3ded1-800f-4a2c-9569-f51b4bf14b49 req-5a2ee5f5-6d55-4efa-b6b6-18b6d605ef24 service nova] Enqueued Resource ID: 074be4e0-ffc9-4ec9-b29a-40406844218c with Priority: HIGHEST for action security_group_rules [ 1020.842210] env[62842]: INFO networking_nsxv3.common.synchronization [req-07e3ded1-800f-4a2c-9569-f51b4bf14b49 req-5a2ee5f5-6d55-4efa-b6b6-18b6d605ef24 service nova] Enqueued Resource ID: 074be4e0-ffc9-4ec9-b29a-40406844218c with Priority: HIGHEST for action security_group_members [ 1020.842483] env[62842]: INFO networking_nsxv3.common.synchronization [req-07e3ded1-800f-4a2c-9569-f51b4bf14b49 req-5a2ee5f5-6d55-4efa-b6b6-18b6d605ef24 service nova] Enqueued Resource ID: 0a0dc132-3c57-4d3e-8f17-c88e3bf67ede with Priority: HIGHEST for action port [ 1020.845782] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 074be4e0-ffc9-4ec9-b29a-40406844218c with Priority: HIGHEST for action security_group_rules [ 1020.846587] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 074be4e0-ffc9-4ec9-b29a-40406844218c with Priority: HIGHEST for action security_group_members [ 1020.847418] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a0dc132-3c57-4d3e-8f17-c88e3bf67ede with Priority: HIGHEST for action port [ 1020.848656] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-074be4e0-ffc9-4ec9-b29a-40406844218c taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.848852] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.848955] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.849838] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.849969] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.852391] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-074be4e0-ffc9-4ec9-b29a-40406844218c taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.852557] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.852889] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a0dc132-3c57-4d3e-8f17-c88e3bf67ede taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.853037] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a0dc132-3c57-4d3e-8f17-c88e3bf67ede" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.853124] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a0dc132-3c57-4d3e-8f17-c88e3bf67ede" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.854631] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a0dc132-3c57-4d3e-8f17-c88e3bf67ede" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.854751] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a0dc132-3c57-4d3e-8f17-c88e3bf67ede',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.859866] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.859866] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.859866] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.859866] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.859866] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.859866] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.859866] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.859866] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.859866] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.859866] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.859866] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.859866] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.859866] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.861058] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.861058] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.861058] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.861058] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.861058] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.861058] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.861058] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.861058] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 is going to be updated. [ 1020.945560] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.945997] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.945997] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.945997] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.946256] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.966177] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 in Status: IN_PROGRESS for 2s [ 1021.357904] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-074be4e0-ffc9-4ec9-b29a-40406844218c taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.357904] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.364284] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0a0dc132-3c57-4d3e-8f17-c88e3bf67ede with status ACTIVE [ 1021.364284] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.364284] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.364284] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.365149] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.367027] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.367027] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.367027] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.367027] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.367027] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.367027] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.367027] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.367027] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.367027] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.367027] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.367027] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.367027] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0a0dc132-3c57-4d3e-8f17-c88e3bf67ede is going to be updated. [ 1021.399889] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.399889] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.399889] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.399889] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.399889] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.399889] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a0dc132-3c57-4d3e-8f17-c88e3bf67ede" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.662134] env[62842]: INFO networking_nsxv3.common.synchronization [req-16fd5fc4-b60e-414d-aa3e-df3402275e7d req-ea1197bb-36c4-46ee-a5b8-b7323dddce8f tempest-ServerDiskConfigTestJSON-797549774 tempest-ServerDiskConfigTestJSON-797549774-project-member] Enqueued Resource ID: c184a589-476a-49bd-9984-d339a77ec8f3 with Priority: HIGHEST for action security_group_members [ 1021.662726] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c184a589-476a-49bd-9984-d339a77ec8f3 with Priority: HIGHEST for action security_group_members [ 1021.663049] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-c184a589-476a-49bd-9984-d339a77ec8f3 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.663175] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.663243] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.663437] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.663599] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.663705] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.663763] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.663907] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.663992] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.664097] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c184a589-476a-49bd-9984-d339a77ec8f3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.917437] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 518e027d-4d1d-4cf5-a557-35f3eb956cd6 in Status: SUCCESS [ 1021.917714] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-518e027d-4d1d-4cf5-a557-35f3eb956cd6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.917924] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-518e027d-4d1d-4cf5-a557-35f3eb956cd6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.918214] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-518e027d-4d1d-4cf5-a557-35f3eb956cd6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.918900] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.919084] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.919213] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.919506] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.919506] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.919616] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-518e027d-4d1d-4cf5-a557-35f3eb956cd6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.919673] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('518e027d-4d1d-4cf5-a557-35f3eb956cd6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.166220] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.166588] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.166588] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.166659] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.166739] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.166933] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.167049] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.167115] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.167264] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.167378] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.167419] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c184a589-476a-49bd-9984-d339a77ec8f3 is going to be deleted. [ 1022.198670] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.198810] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.198881] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.199102] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.199197] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.199316] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.359883] env[62842]: INFO networking_nsxv3.common.synchronization [req-8cf17fdd-f79b-4378-a83e-05e0b18fff33 req-af07734c-165c-4940-9c57-10a5e15814ad tempest-MultipleCreateTestJSON-1704086459 tempest-MultipleCreateTestJSON-1704086459-project-member] Enqueued Resource ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 with Priority: HIGHEST for action security_group_members [ 1022.360468] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 with Priority: HIGHEST for action security_group_members [ 1022.360783] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-29a28398-6e5b-4a4f-81e9-a2f458468c19 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.360942] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.361069] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.361370] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.361648] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.361801] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.361886] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.362080] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.362195] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.362346] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29a28398-6e5b-4a4f-81e9-a2f458468c19',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.423610] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('518e027d-4d1d-4cf5-a557-35f3eb956cd6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.449025] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-51 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.449025] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-51" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.449025] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-51" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.449025] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-51" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.449025] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.449025] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.449025] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.449025] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.449025] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.449025] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1022.449025] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1022.449025] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1022.449025] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1022.449790] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1022.449790] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1022.449790] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1022.471479] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1022.471698] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1022.471848] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1022.472574] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-51" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.472574] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-92236081-8ca5-4853-a465-9fba6f534cbe taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.472750] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-92236081-8ca5-4853-a465-9fba6f534cbe" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.473602] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-92236081-8ca5-4853-a465-9fba6f534cbe" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.473602] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-92236081-8ca5-4853-a465-9fba6f534cbe" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.473602] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92236081-8ca5-4853-a465-9fba6f534cbe',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.531337] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 074be4e0-ffc9-4ec9-b29a-40406844218c in Status: SUCCESS [ 1022.531850] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.531850] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.532092] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.532181] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.532338] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.532400] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.532590] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.532663] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.532714] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.747178] env[62842]: INFO networking_nsxv3.common.synchronization [req-12950beb-9cee-4427-988f-9d4539364256 req-8b4c9cfb-fc50-47f2-85e6-6e235f2805c5 tempest-MultipleCreateTestJSON-1704086459 tempest-MultipleCreateTestJSON-1704086459-project-member] Enqueued Resource ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 with Priority: HIGHEST for action security_group_members [ 1022.747178] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 with Priority: HIGHEST for action security_group_members [ 1022.747178] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-29a28398-6e5b-4a4f-81e9-a2f458468c19 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.750579] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.864374] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('29a28398-6e5b-4a4f-81e9-a2f458468c19',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.925897] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 518e027d-4d1d-4cf5-a557-35f3eb956cd6: rpc.has_security_group_logging(os_id): False [ 1022.946351] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.946531] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.946615] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.946908] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.947138] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.947417] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.947553] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.947634] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.947845] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.947945] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.948655] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 518e027d-4d1d-4cf5-a557-35f3eb956cd6 is going to be created. [ 1022.981168] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.981168] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.981168] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.981168] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.981168] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.981447] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 92236081-8ca5-4853-a465-9fba6f534cbe not found, creating... [ 1022.981789] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.982082] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.982405] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.982778] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.986464] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.986955] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.987186] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.987349] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.987701] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.987922] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.988090] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 92236081-8ca5-4853-a465-9fba6f534cbe is going to be created. [ 1022.990029] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 in Status: SUCCESS [ 1022.990227] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.009379] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.009697] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.009847] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.010155] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.010409] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.010668] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-92236081-8ca5-4853-a465-9fba6f534cbe" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.022545] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.022819] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.022938] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.023190] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.023402] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.040063] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 518e027d-4d1d-4cf5-a557-35f3eb956cd6 in Status: IN_PROGRESS for 2s [ 1023.040442] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.366990] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('29a28398-6e5b-4a4f-81e9-a2f458468c19',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.543259] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.871591] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.871838] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.872287] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.872287] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.872482] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.872482] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 is going to be updated. [ 1023.881709] env[62842]: INFO networking_nsxv3.common.synchronization [req-8c8c6106-e572-44cb-b305-12315f7191a5 req-c128b477-0141-4e1c-88cd-3b2a3439d59f tempest-AttachInterfacesTestJSON-2140085841 tempest-AttachInterfacesTestJSON-2140085841-project-member] Enqueued Resource ID: ae20759e-0e4f-4e29-8897-7eb813e03b32 with Priority: HIGHEST for action security_group_members [ 1023.882416] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae20759e-0e4f-4e29-8897-7eb813e03b32 with Priority: HIGHEST for action security_group_members [ 1023.882803] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae20759e-0e4f-4e29-8897-7eb813e03b32 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.882946] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae20759e-0e4f-4e29-8897-7eb813e03b32" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.883508] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae20759e-0e4f-4e29-8897-7eb813e03b32" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.883508] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae20759e-0e4f-4e29-8897-7eb813e03b32" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.883604] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.883719] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.883816] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.884050] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.884185] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.884324] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae20759e-0e4f-4e29-8897-7eb813e03b32',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.908662] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.908662] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.908662] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.908662] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.908662] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.910822] env[62842]: INFO networking_nsxv3.common.synchronization [req-16fd5fc4-b60e-414d-aa3e-df3402275e7d req-496329be-9538-4ea6-8400-edf7bdbca5de service nova] Enqueued Resource ID: c184a589-476a-49bd-9984-d339a77ec8f3 with Priority: HIGHEST for action security_group_rules [ 1023.911019] env[62842]: INFO networking_nsxv3.common.synchronization [req-16fd5fc4-b60e-414d-aa3e-df3402275e7d req-496329be-9538-4ea6-8400-edf7bdbca5de service nova] Enqueued Resource ID: c184a589-476a-49bd-9984-d339a77ec8f3 with Priority: HIGHEST for action security_group_members [ 1023.911160] env[62842]: INFO networking_nsxv3.common.synchronization [req-16fd5fc4-b60e-414d-aa3e-df3402275e7d req-496329be-9538-4ea6-8400-edf7bdbca5de service nova] Enqueued Resource ID: 92236081-8ca5-4853-a465-9fba6f534cbe with Priority: HIGHEST for action port [ 1023.911440] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c184a589-476a-49bd-9984-d339a77ec8f3 with Priority: HIGHEST for action security_group_rules [ 1023.911582] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c184a589-476a-49bd-9984-d339a77ec8f3 with Priority: HIGHEST for action security_group_members [ 1023.911669] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92236081-8ca5-4853-a465-9fba6f534cbe with Priority: HIGHEST for action port [ 1023.912280] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c184a589-476a-49bd-9984-d339a77ec8f3 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.912365] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.913033] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.913033] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.913033] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c184a589-476a-49bd-9984-d339a77ec8f3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.915882] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-c184a589-476a-49bd-9984-d339a77ec8f3 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.915882] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.915882] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.916111] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.916111] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.916191] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.916239] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.916466] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.916565] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.916627] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c184a589-476a-49bd-9984-d339a77ec8f3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.918160] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-92236081-8ca5-4853-a465-9fba6f534cbe taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.918160] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92236081-8ca5-4853-a465-9fba6f534cbe" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.918160] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92236081-8ca5-4853-a465-9fba6f534cbe" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.918160] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92236081-8ca5-4853-a465-9fba6f534cbe" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.918160] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92236081-8ca5-4853-a465-9fba6f534cbe',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.922090] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 in Status: IN_PROGRESS for 2s [ 1024.047704] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.047918] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.047966] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.048215] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.048322] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.048428] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 074be4e0-ffc9-4ec9-b29a-40406844218c is going to be updated. [ 1024.104619] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.104823] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.104902] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.105079] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.105250] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.132534] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 074be4e0-ffc9-4ec9-b29a-40406844218c in Status: IN_PROGRESS for 2s [ 1024.148605] env[62842]: INFO networking_nsxv3.common.synchronization [req-8c8a1231-3a1c-4ff8-88ab-3c0b02cce888 req-0e0012dc-32eb-4e4d-a7cf-c2a421c1b7de tempest-ServerActionsTestJSON-670456711 tempest-ServerActionsTestJSON-670456711-project-member] Enqueued Resource ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 with Priority: HIGHEST for action security_group_members [ 1024.148957] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 with Priority: HIGHEST for action security_group_members [ 1024.150917] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a03224f-b75b-48a5-9e23-3ca50aabbb33 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.151077] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.151185] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.151898] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.152510] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.152657] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.152741] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.152870] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.153831] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.153831] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a03224f-b75b-48a5-9e23-3ca50aabbb33',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.387509] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.388427] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.388427] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.388427] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.388427] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.388427] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.388427] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.388649] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.388683] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.389039] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.389039] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae20759e-0e4f-4e29-8897-7eb813e03b32 is going to be updated. [ 1024.419419] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c184a589-476a-49bd-9984-d339a77ec8f3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.421113] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-c184a589-476a-49bd-9984-d339a77ec8f3 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.421242] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.421531] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 92236081-8ca5-4853-a465-9fba6f534cbe with status ACTIVE [ 1024.421703] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.421859] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.421940] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.422586] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.422586] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.423702] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.423702] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.423702] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.423702] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.423702] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.423702] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.423702] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.423702] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.424048] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.424048] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.424048] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 92236081-8ca5-4853-a465-9fba6f534cbe is going to be updated. [ 1024.426593] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.426593] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.426593] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.426774] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.427364] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.444308] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae20759e-0e4f-4e29-8897-7eb813e03b32 in Status: IN_PROGRESS for 2s [ 1024.454783] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.454783] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.454783] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.454783] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.454783] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.454783] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92236081-8ca5-4853-a465-9fba6f534cbe" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.659022] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.659022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.659022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.659022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.659022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.659022] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.659022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.659022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.659022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.659022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.659022] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 is going to be deleted. [ 1024.674109] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-830 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.674665] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-830" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.674884] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-830" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.675256] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-830" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.675658] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.677479] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.677668] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.677955] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.678134] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.678385] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1024.678522] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1024.678644] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1024.680013] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1024.680013] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1024.680013] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1024.680013] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1024.690989] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.691165] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.691223] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.691536] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.691627] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.691806] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.700263] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1024.700451] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1024.700622] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1024.700842] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-830" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.701337] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-fd599c62-894b-4e2b-aa82-791ee45ef8bf taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.701545] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-fd599c62-894b-4e2b-aa82-791ee45ef8bf" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.701690] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-fd599c62-894b-4e2b-aa82-791ee45ef8bf" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.702064] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-fd599c62-894b-4e2b-aa82-791ee45ef8bf" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.703268] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd599c62-894b-4e2b-aa82-791ee45ef8bf',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.929012] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c184a589-476a-49bd-9984-d339a77ec8f3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.050111] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 518e027d-4d1d-4cf5-a557-35f3eb956cd6 in Status: SUCCESS [ 1025.050399] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-518e027d-4d1d-4cf5-a557-35f3eb956cd6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.204587] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.204958] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.205151] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.205475] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.205702] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.205971] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port fd599c62-894b-4e2b-aa82-791ee45ef8bf not found, creating... [ 1025.206328] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.206556] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.206780] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.207063] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.207235] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.207557] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.207754] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.207933] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.208301] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.208486] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.208638] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: fd599c62-894b-4e2b-aa82-791ee45ef8bf is going to be created. [ 1025.232333] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.232657] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.232815] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.233150] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.233408] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.233735] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-fd599c62-894b-4e2b-aa82-791ee45ef8bf" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.433987] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.434511] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.434511] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.434751] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.434823] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.434909] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c184a589-476a-49bd-9984-d339a77ec8f3 is going to be created. [ 1025.466532] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.466532] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.466532] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.466532] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.466532] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.477317] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c184a589-476a-49bd-9984-d339a77ec8f3 in Status: UNINITIALIZED for 2s [ 1025.932932] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 in Status: SUCCESS [ 1025.933238] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.933545] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.933943] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.934380] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.935330] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.935330] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.935330] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.935330] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.935492] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29a28398-6e5b-4a4f-81e9-a2f458468c19',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.053421] env[62842]: INFO networking_nsxv3.common.synchronization [req-8c8a1231-3a1c-4ff8-88ab-3c0b02cce888 req-f89536db-bd9f-4af3-8a39-0f8992833602 service nova] Enqueued Resource ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 with Priority: HIGHEST for action security_group_rules [ 1026.053421] env[62842]: INFO networking_nsxv3.common.synchronization [req-8c8a1231-3a1c-4ff8-88ab-3c0b02cce888 req-f89536db-bd9f-4af3-8a39-0f8992833602 service nova] Enqueued Resource ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 with Priority: HIGHEST for action security_group_members [ 1026.053421] env[62842]: INFO networking_nsxv3.common.synchronization [req-8c8a1231-3a1c-4ff8-88ab-3c0b02cce888 req-f89536db-bd9f-4af3-8a39-0f8992833602 service nova] Enqueued Resource ID: fd599c62-894b-4e2b-aa82-791ee45ef8bf with Priority: HIGHEST for action port [ 1026.053735] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 with Priority: HIGHEST for action security_group_rules [ 1026.053870] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 with Priority: HIGHEST for action security_group_members [ 1026.054213] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd599c62-894b-4e2b-aa82-791ee45ef8bf with Priority: HIGHEST for action port [ 1026.054643] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a03224f-b75b-48a5-9e23-3ca50aabbb33 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.054773] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.054834] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.055061] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.056129] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a03224f-b75b-48a5-9e23-3ca50aabbb33',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.057501] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a03224f-b75b-48a5-9e23-3ca50aabbb33 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.057501] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.057501] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.057501] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.057501] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.057745] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.057745] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.057925] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.058177] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.058230] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a03224f-b75b-48a5-9e23-3ca50aabbb33',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.059430] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd599c62-894b-4e2b-aa82-791ee45ef8bf taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.059503] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd599c62-894b-4e2b-aa82-791ee45ef8bf" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.059559] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd599c62-894b-4e2b-aa82-791ee45ef8bf" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.059736] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd599c62-894b-4e2b-aa82-791ee45ef8bf" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.059813] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd599c62-894b-4e2b-aa82-791ee45ef8bf',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.146085] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 074be4e0-ffc9-4ec9-b29a-40406844218c in Status: SUCCESS [ 1026.146334] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.146509] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.146739] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.146939] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.147071] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.147134] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.147290] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.147370] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.147453] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.147547] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.438330] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.439618] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.439618] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.439618] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.439618] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.439942] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.439942] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.440130] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.440198] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.440348] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.440418] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 is going to be updated. [ 1026.457792] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae20759e-0e4f-4e29-8897-7eb813e03b32 in Status: SUCCESS [ 1026.457991] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae20759e-0e4f-4e29-8897-7eb813e03b32 deletion is rescheduled due to dependency. [ 1026.458140] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae20759e-0e4f-4e29-8897-7eb813e03b32" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.472893] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.473120] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.473120] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.473580] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.473727] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.484461] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 in Status: IN_PROGRESS for 2s [ 1026.557645] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a03224f-b75b-48a5-9e23-3ca50aabbb33 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.558074] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.561498] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a03224f-b75b-48a5-9e23-3ca50aabbb33',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.562689] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fd599c62-894b-4e2b-aa82-791ee45ef8bf with status ACTIVE [ 1026.562907] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.563068] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.563190] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.563347] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.563437] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.563823] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.563823] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.563823] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.564044] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.564044] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.564427] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.564427] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.564427] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.564427] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.564632] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.564632] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fd599c62-894b-4e2b-aa82-791ee45ef8bf is going to be updated. [ 1026.591116] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.591116] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.591116] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.591439] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.591973] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.591973] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd599c62-894b-4e2b-aa82-791ee45ef8bf" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.634927] env[62842]: INFO networking_nsxv3.common.synchronization [req-d8a649ad-55cb-4f20-b647-e0f1788c7353 req-229690e6-6e53-472e-8aa7-d7ccd2437772 tempest-DeleteServersTestJSON-1113791748 tempest-DeleteServersTestJSON-1113791748-project-member] Enqueued Resource ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 with Priority: HIGHEST for action security_group_members [ 1026.635485] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 with Priority: HIGHEST for action security_group_members [ 1026.635788] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-35146777-fd28-4ac7-b454-f7dd3fbb5846 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.635912] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.635976] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.636223] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.636382] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.636481] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.636544] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.636699] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.636786] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.636877] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('35146777-fd28-4ac7-b454-f7dd3fbb5846',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.649522] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-074be4e0-ffc9-4ec9-b29a-40406844218c taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.649645] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.649729] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.649921] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.650110] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.650213] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.650277] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.650713] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.650713] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.650713] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.650806] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-074be4e0-ffc9-4ec9-b29a-40406844218c taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.650893] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.650971] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.651130] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.651267] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.651417] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.651476] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.651612] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.651691] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.651771] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.651861] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.067670] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a03224f-b75b-48a5-9e23-3ca50aabbb33',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.074019] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-681 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.074019] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-681" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.074019] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-681" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.074019] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-681" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.074019] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.074019] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.074019] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.074019] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.074019] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.074019] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1027.074019] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1027.074019] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1027.074019] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1027.074519] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1027.074858] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1027.075526] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1027.097976] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1027.101056] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1027.101056] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1027.101056] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-681" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.101056] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-9b0dbe35-0361-448e-a101-8dedf3857649 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.101056] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-9b0dbe35-0361-448e-a101-8dedf3857649" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.101056] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-9b0dbe35-0361-448e-a101-8dedf3857649" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.101056] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-9b0dbe35-0361-448e-a101-8dedf3857649" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.101056] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b0dbe35-0361-448e-a101-8dedf3857649',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.142510] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.142510] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.142510] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.142510] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.142510] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.142510] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.142510] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.142510] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.142510] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.142510] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.142510] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 is going to be deleted. [ 1027.155504] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 074be4e0-ffc9-4ec9-b29a-40406844218c: rpc.has_security_group_logging(os_id): False [ 1027.174105] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.174105] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.174105] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.174105] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.174105] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.174105] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.174940] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.175087] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.175126] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.175397] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.197225] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.197513] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.197659] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.197739] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.197944] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.198043] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.198251] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.198356] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.198420] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.198569] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.198645] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.198824] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.198920] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.199499] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.199773] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.199842] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.200354] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 074be4e0-ffc9-4ec9-b29a-40406844218c is going to be updated. [ 1027.267413] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.267667] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.267793] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.268060] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.268215] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.284517] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 074be4e0-ffc9-4ec9-b29a-40406844218c in Status: IN_PROGRESS for 2s [ 1027.487976] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c184a589-476a-49bd-9984-d339a77ec8f3 in Status: SUCCESS [ 1027.488368] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.488416] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.488772] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.489034] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.489187] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.489277] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.489483] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.489590] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.489702] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.489821] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c184a589-476a-49bd-9984-d339a77ec8f3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.571646] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.572959] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.572959] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.572959] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.572959] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.572959] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 is going to be created. [ 1027.606136] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.606412] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.606553] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.606849] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.607014] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.607794] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 9b0dbe35-0361-448e-a101-8dedf3857649 not found, creating... [ 1027.607794] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.607794] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.607794] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.608046] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.608087] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.608728] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.608728] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.608728] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.609039] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.609465] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.609465] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 9b0dbe35-0361-448e-a101-8dedf3857649 is going to be created. [ 1027.611539] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.611539] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.611704] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.611745] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.612562] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.624893] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 in Status: UNINITIALIZED for 2s [ 1027.637410] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.637410] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.637410] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.637706] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.638562] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.638562] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-9b0dbe35-0361-448e-a101-8dedf3857649" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.992268] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-c184a589-476a-49bd-9984-d339a77ec8f3 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.992562] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.992562] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.992692] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.992850] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.992967] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.993099] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.993177] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.993246] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.993334] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.993480] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-c184a589-476a-49bd-9984-d339a77ec8f3 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.993590] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.993686] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.994105] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.994105] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.994306] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.994306] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.994427] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.994539] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.994630] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.994724] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c184a589-476a-49bd-9984-d339a77ec8f3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.499024] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 in Status: SUCCESS [ 1028.499024] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 deletion is rescheduled due to dependency. [ 1028.499024] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.500042] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c184a589-476a-49bd-9984-d339a77ec8f3: rpc.has_security_group_logging(os_id): False [ 1028.520516] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.521011] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.521011] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.521115] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.521237] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.521565] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.521670] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.521799] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.521975] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.522080] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.522266] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.522419] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.523307] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.523307] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.523307] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.523307] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.523307] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.523307] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.523307] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.523307] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.523697] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c184a589-476a-49bd-9984-d339a77ec8f3 is going to be created. [ 1028.526867] env[62842]: INFO networking_nsxv3.common.synchronization [req-d8a649ad-55cb-4f20-b647-e0f1788c7353 req-455ce53b-d605-404d-8370-4c457a7d0cd1 service nova] Enqueued Resource ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 with Priority: HIGHEST for action security_group_rules [ 1028.527068] env[62842]: INFO networking_nsxv3.common.synchronization [req-d8a649ad-55cb-4f20-b647-e0f1788c7353 req-455ce53b-d605-404d-8370-4c457a7d0cd1 service nova] Enqueued Resource ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 with Priority: HIGHEST for action security_group_members [ 1028.527224] env[62842]: INFO networking_nsxv3.common.synchronization [req-d8a649ad-55cb-4f20-b647-e0f1788c7353 req-455ce53b-d605-404d-8370-4c457a7d0cd1 service nova] Enqueued Resource ID: 9b0dbe35-0361-448e-a101-8dedf3857649 with Priority: HIGHEST for action port [ 1028.527888] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 with Priority: HIGHEST for action security_group_rules [ 1028.527941] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 with Priority: HIGHEST for action security_group_members [ 1028.528050] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b0dbe35-0361-448e-a101-8dedf3857649 with Priority: HIGHEST for action port [ 1028.528385] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-35146777-fd28-4ac7-b454-f7dd3fbb5846 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.528504] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.528567] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.528768] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.528845] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('35146777-fd28-4ac7-b454-f7dd3fbb5846',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.530433] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-35146777-fd28-4ac7-b454-f7dd3fbb5846 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.530617] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.530734] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.531016] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.531299] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.531462] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.531554] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.531774] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.531882] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.532930] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('35146777-fd28-4ac7-b454-f7dd3fbb5846',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.533249] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b0dbe35-0361-448e-a101-8dedf3857649 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.533249] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b0dbe35-0361-448e-a101-8dedf3857649" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.533374] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b0dbe35-0361-448e-a101-8dedf3857649" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.533551] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b0dbe35-0361-448e-a101-8dedf3857649" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.533666] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b0dbe35-0361-448e-a101-8dedf3857649',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.586663] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.586875] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.586875] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.587090] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.587271] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.609546] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c184a589-476a-49bd-9984-d339a77ec8f3 in Status: IN_PROGRESS for 2s [ 1029.035878] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('35146777-fd28-4ac7-b454-f7dd3fbb5846',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.038487] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-35146777-fd28-4ac7-b454-f7dd3fbb5846 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.038487] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.038487] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9b0dbe35-0361-448e-a101-8dedf3857649 with status ACTIVE [ 1029.038487] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.038487] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.038487] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.038487] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.038487] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.038487] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.038487] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.039033] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.039033] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.039033] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.040026] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.040157] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.040224] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.040382] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.040580] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.043239] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9b0dbe35-0361-448e-a101-8dedf3857649 is going to be updated. [ 1029.068738] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.069068] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.069175] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.069489] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.069635] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.069803] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b0dbe35-0361-448e-a101-8dedf3857649" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.257134] env[62842]: INFO networking_nsxv3.common.synchronization [req-be3b327a-66b2-4f49-a50e-4b157a8890a4 req-8b9a4d52-3aed-45da-96f3-a2d165b69548 tempest-ServerPasswordTestJSON-1985920430 tempest-ServerPasswordTestJSON-1985920430-project-member] Enqueued Resource ID: 789b6627-9a06-47bb-b607-d6625f262f66 with Priority: HIGHEST for action security_group_members [ 1029.257401] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 789b6627-9a06-47bb-b607-d6625f262f66 with Priority: HIGHEST for action security_group_members [ 1029.257633] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-789b6627-9a06-47bb-b607-d6625f262f66 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.257755] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-789b6627-9a06-47bb-b607-d6625f262f66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.257828] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-789b6627-9a06-47bb-b607-d6625f262f66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.258079] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-789b6627-9a06-47bb-b607-d6625f262f66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.258256] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.258399] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.258493] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.258880] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.258880] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.258880] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('789b6627-9a06-47bb-b607-d6625f262f66',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.306640] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 074be4e0-ffc9-4ec9-b29a-40406844218c in Status: SUCCESS [ 1029.306880] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.546732] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('35146777-fd28-4ac7-b454-f7dd3fbb5846',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.635800] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 in Status: SUCCESS [ 1029.636073] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.636332] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.636699] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.636958] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.637131] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.637268] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.637539] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.637690] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.637851] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.638054] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0a03224f-b75b-48a5-9e23-3ca50aabbb33',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.670753] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-525 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.671045] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-525" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.671236] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-525" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.671712] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-525" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.672090] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.672350] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.672531] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.672828] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.673055] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.673346] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1029.673514] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1029.673685] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1029.673821] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1029.673986] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1029.674149] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1029.674377] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1029.695627] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1029.695914] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1029.696076] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1029.696291] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-525" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.696658] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-53875625-0399-4152-920b-188f9fe81c51 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.696840] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-53875625-0399-4152-920b-188f9fe81c51" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.696986] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-53875625-0399-4152-920b-188f9fe81c51" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.697375] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-53875625-0399-4152-920b-188f9fe81c51" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.697540] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53875625-0399-4152-920b-188f9fe81c51',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.761540] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.761810] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.761920] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.762199] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.762323] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.762598] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.762721] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.762836] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.763079] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.763186] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.763344] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 789b6627-9a06-47bb-b607-d6625f262f66 already deleted. [ 1029.763461] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-789b6627-9a06-47bb-b607-d6625f262f66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.050229] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.050500] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.050500] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.050744] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.050853] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.051025] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 is going to be created. [ 1030.078371] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.078544] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.078628] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.078886] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.079085] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.089824] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 in Status: UNINITIALIZED for 2s [ 1030.140436] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0a03224f-b75b-48a5-9e23-3ca50aabbb33',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.201035] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.201216] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.201348] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.201720] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.201906] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.202060] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 53875625-0399-4152-920b-188f9fe81c51 not found, creating... [ 1030.202370] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.202538] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.202661] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.202951] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.203086] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.203400] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.203596] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.203819] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.204138] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.204292] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.204439] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 53875625-0399-4152-920b-188f9fe81c51 is going to be created. [ 1030.226678] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.226958] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.227142] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.227530] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.227827] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.228168] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-53875625-0399-4152-920b-188f9fe81c51" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.631349] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c184a589-476a-49bd-9984-d339a77ec8f3 in Status: SUCCESS [ 1030.631879] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.645427] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0a03224f-b75b-48a5-9e23-3ca50aabbb33: rpc.has_security_group_logging(os_id): False [ 1030.667711] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.667977] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.667977] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.668179] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.668273] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.668577] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.668710] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.668792] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.668953] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.669062] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.669158] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 is going to be created. [ 1030.754227] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.754442] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.754497] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.754709] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.755040] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.811898] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 in Status: IN_PROGRESS for 2s [ 1031.572028] env[62842]: INFO networking_nsxv3.common.synchronization [req-be3b327a-66b2-4f49-a50e-4b157a8890a4 req-604d7dc1-fba3-44f6-86bc-1aa38adfea4a service nova] Enqueued Resource ID: 789b6627-9a06-47bb-b607-d6625f262f66 with Priority: HIGHEST for action security_group_rules [ 1031.572028] env[62842]: INFO networking_nsxv3.common.synchronization [req-be3b327a-66b2-4f49-a50e-4b157a8890a4 req-604d7dc1-fba3-44f6-86bc-1aa38adfea4a service nova] Enqueued Resource ID: 789b6627-9a06-47bb-b607-d6625f262f66 with Priority: HIGHEST for action security_group_members [ 1031.572028] env[62842]: INFO networking_nsxv3.common.synchronization [req-be3b327a-66b2-4f49-a50e-4b157a8890a4 req-604d7dc1-fba3-44f6-86bc-1aa38adfea4a service nova] Enqueued Resource ID: 53875625-0399-4152-920b-188f9fe81c51 with Priority: HIGHEST for action port [ 1031.572028] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 789b6627-9a06-47bb-b607-d6625f262f66 with Priority: HIGHEST for action security_group_rules [ 1031.572510] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 789b6627-9a06-47bb-b607-d6625f262f66 with Priority: HIGHEST for action security_group_members [ 1031.572810] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53875625-0399-4152-920b-188f9fe81c51 with Priority: HIGHEST for action port [ 1031.573259] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-789b6627-9a06-47bb-b607-d6625f262f66 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.575719] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-789b6627-9a06-47bb-b607-d6625f262f66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.575719] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-789b6627-9a06-47bb-b607-d6625f262f66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.575719] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-789b6627-9a06-47bb-b607-d6625f262f66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.575719] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('789b6627-9a06-47bb-b607-d6625f262f66',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.575719] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-789b6627-9a06-47bb-b607-d6625f262f66 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.575719] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-789b6627-9a06-47bb-b607-d6625f262f66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.575719] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-789b6627-9a06-47bb-b607-d6625f262f66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.575960] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-789b6627-9a06-47bb-b607-d6625f262f66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.576163] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.576300] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.576392] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.576575] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.576957] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.576957] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('789b6627-9a06-47bb-b607-d6625f262f66',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.577869] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-53875625-0399-4152-920b-188f9fe81c51 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.577927] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-53875625-0399-4152-920b-188f9fe81c51" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.578575] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-53875625-0399-4152-920b-188f9fe81c51" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.578575] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-53875625-0399-4152-920b-188f9fe81c51" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.578575] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53875625-0399-4152-920b-188f9fe81c51',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.080883] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-789b6627-9a06-47bb-b607-d6625f262f66 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.081365] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-789b6627-9a06-47bb-b607-d6625f262f66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.081365] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('789b6627-9a06-47bb-b607-d6625f262f66',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.082462] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 53875625-0399-4152-920b-188f9fe81c51 with status ACTIVE [ 1032.082674] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.082809] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.082923] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.083238] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.083369] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.083671] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.083884] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.083994] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.084205] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.084377] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.084789] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.084789] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.084893] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.085088] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.085225] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.085342] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 53875625-0399-4152-920b-188f9fe81c51 is going to be updated. [ 1032.100739] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 in Status: SUCCESS [ 1032.100803] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.101375] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.101672] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.101926] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.102091] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.102180] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.102399] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.102512] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.102674] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.102725] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('35146777-fd28-4ac7-b454-f7dd3fbb5846',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.124098] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.124276] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.124355] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.124594] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.124743] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.124916] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-53875625-0399-4152-920b-188f9fe81c51" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.588140] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('789b6627-9a06-47bb-b607-d6625f262f66',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.605583] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-35146777-fd28-4ac7-b454-f7dd3fbb5846 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.605855] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.605855] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.606090] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.608140] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.608262] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.608339] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.608599] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.608693] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.608785] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.608946] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-35146777-fd28-4ac7-b454-f7dd3fbb5846 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.609051] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.609102] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.609254] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.609414] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.609513] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.609567] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.609708] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.609798] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.609900] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.609989] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('35146777-fd28-4ac7-b454-f7dd3fbb5846',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.829920] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 in Status: SUCCESS [ 1032.830863] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.091351] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.091675] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.091675] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.091821] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.091911] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.092049] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 789b6627-9a06-47bb-b607-d6625f262f66 is going to be created. [ 1033.112904] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 35146777-fd28-4ac7-b454-f7dd3fbb5846: rpc.has_security_group_logging(os_id): False [ 1033.120457] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.120631] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.120730] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.120953] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.121172] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.130508] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 789b6627-9a06-47bb-b607-d6625f262f66 in Status: UNINITIALIZED for 2s [ 1033.133627] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.133776] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.133776] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.133978] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.134584] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.134584] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.134584] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.134584] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.134584] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.134838] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.134838] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.134912] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.134943] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.135093] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.135172] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.135367] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.135463] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.135525] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.135666] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.135740] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.135821] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 is going to be created. [ 1033.201572] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.201815] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.201945] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.202255] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.203028] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.221367] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 in Status: IN_PROGRESS for 2s [ 1033.544478] env[62842]: INFO networking_nsxv3.common.synchronization [req-b00e2850-f050-4298-a1bf-f926b873eedd req-eb331ae7-3170-4950-8308-474bdc715a8b tempest-ServersTestJSON-1267616671 tempest-ServersTestJSON-1267616671-project-member] Enqueued Resource ID: 074be4e0-ffc9-4ec9-b29a-40406844218c with Priority: HIGHEST for action security_group_members [ 1033.545052] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 074be4e0-ffc9-4ec9-b29a-40406844218c with Priority: HIGHEST for action security_group_members [ 1033.545365] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-074be4e0-ffc9-4ec9-b29a-40406844218c taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.545515] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.545588] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.545785] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.545943] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.549200] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.549314] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.549566] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.549715] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.549792] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.053860] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.557748] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.061264] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.061264] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.061487] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.061739] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.061739] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.061826] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 074be4e0-ffc9-4ec9-b29a-40406844218c is going to be updated. [ 1035.096493] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.096643] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.096742] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.096901] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.097053] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.107650] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 074be4e0-ffc9-4ec9-b29a-40406844218c in Status: IN_PROGRESS for 2s [ 1035.141137] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 789b6627-9a06-47bb-b607-d6625f262f66 in Status: SUCCESS [ 1035.141137] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-789b6627-9a06-47bb-b607-d6625f262f66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.141137] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-789b6627-9a06-47bb-b607-d6625f262f66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.141298] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-789b6627-9a06-47bb-b607-d6625f262f66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.141491] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.141633] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.141711] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.141885] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.141981] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.142105] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-789b6627-9a06-47bb-b607-d6625f262f66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.142210] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('789b6627-9a06-47bb-b607-d6625f262f66',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.237023] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 in Status: SUCCESS [ 1035.237294] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.648021] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-789b6627-9a06-47bb-b607-d6625f262f66 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.648021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-789b6627-9a06-47bb-b607-d6625f262f66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.648021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-789b6627-9a06-47bb-b607-d6625f262f66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.648021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-789b6627-9a06-47bb-b607-d6625f262f66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.648021] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.648021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.648021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.648021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.648021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.648021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-789b6627-9a06-47bb-b607-d6625f262f66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.648021] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-789b6627-9a06-47bb-b607-d6625f262f66 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.648021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-789b6627-9a06-47bb-b607-d6625f262f66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.648021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-789b6627-9a06-47bb-b607-d6625f262f66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.648021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-789b6627-9a06-47bb-b607-d6625f262f66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.648021] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.648021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.648823] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.648823] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.648823] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.648823] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-789b6627-9a06-47bb-b607-d6625f262f66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.648823] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('789b6627-9a06-47bb-b607-d6625f262f66',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.883025] env[62842]: INFO networking_nsxv3.common.synchronization [req-010068e2-15fe-4aa3-b688-d523464451e2 req-3fbf2e04-11f3-4b3f-bad3-cb6339aba93a tempest-ImagesTestJSON-1786483082 tempest-ImagesTestJSON-1786483082-project-member] Enqueued Resource ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 with Priority: HIGHEST for action security_group_members [ 1035.883025] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 with Priority: HIGHEST for action security_group_members [ 1035.883025] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e26630c-b3f7-4b48-9720-77b59135adf4 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.883025] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.883025] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.883025] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.883025] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.883025] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.883025] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.883025] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.883025] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.883025] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e26630c-b3f7-4b48-9720-77b59135adf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.151131] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 789b6627-9a06-47bb-b607-d6625f262f66: rpc.has_security_group_logging(os_id): False [ 1036.169708] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.169870] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.169957] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.170147] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.170237] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.170839] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.170839] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.170839] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.170839] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.170839] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.171031] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.171031] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.171099] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.171230] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.171304] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.171515] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.171606] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.171669] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.171804] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.172144] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.172144] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 789b6627-9a06-47bb-b607-d6625f262f66 is going to be created. [ 1036.228462] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.228731] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.228731] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.228873] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.229710] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.240829] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 789b6627-9a06-47bb-b607-d6625f262f66 in Status: IN_PROGRESS for 2s [ 1036.387784] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.388013] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.388013] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.388263] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.388405] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.388567] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.388674] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.388713] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.388861] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.388933] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.389060] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 is going to be updated. [ 1036.425444] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.425728] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.425728] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.426061] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.426210] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.437092] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 in Status: IN_PROGRESS for 2s [ 1037.120263] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 074be4e0-ffc9-4ec9-b29a-40406844218c in Status: SUCCESS [ 1037.120615] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.960516] env[62842]: INFO networking_nsxv3.common.synchronization [req-be3394fa-fc54-4117-a590-a65221504d1e req-11ced590-f4c1-4a8e-9e4b-dcdd6276e71c tempest-ServerActionsTestOtherA-1611322165 tempest-ServerActionsTestOtherA-1611322165-project-member] Enqueued Resource ID: 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 with Priority: HIGHEST for action security_group_members [ 1037.961812] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 with Priority: HIGHEST for action security_group_members [ 1037.962260] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.962450] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.962555] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.962813] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.963043] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.963184] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.963278] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.963489] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.963610] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.963750] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.254490] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 789b6627-9a06-47bb-b607-d6625f262f66 in Status: SUCCESS [ 1038.254781] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-789b6627-9a06-47bb-b607-d6625f262f66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.448666] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 in Status: SUCCESS [ 1038.449350] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 deletion is rescheduled due to dependency. [ 1038.449350] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.468733] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.533875] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-8 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.534170] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.534247] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.534534] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.534777] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.536892] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.537190] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.537494] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.537668] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.538014] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1038.538180] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1038.538330] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1038.538877] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1038.539068] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1038.539224] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1038.539419] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1038.560362] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1038.560516] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1038.560654] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1038.560837] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.561177] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-5aee4f25-0316-43bf-8a85-0a6dafd32df8 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.561345] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-5aee4f25-0316-43bf-8a85-0a6dafd32df8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.561500] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-5aee4f25-0316-43bf-8a85-0a6dafd32df8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.561833] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-5aee4f25-0316-43bf-8a85-0a6dafd32df8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.561969] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5aee4f25-0316-43bf-8a85-0a6dafd32df8',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.976295] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.068645] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.068645] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.068645] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.068645] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.068645] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.068645] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 5aee4f25-0316-43bf-8a85-0a6dafd32df8 not found, creating... [ 1039.069562] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.069878] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.070997] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.070997] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.070997] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.070997] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.071595] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.071832] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.072230] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.072565] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.072802] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 5aee4f25-0316-43bf-8a85-0a6dafd32df8 is going to be created. [ 1039.097561] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.098185] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.098185] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.098413] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.098740] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.102497] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-5aee4f25-0316-43bf-8a85-0a6dafd32df8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.270589] env[62842]: INFO networking_nsxv3.common.synchronization [None req-2d300989-fb8a-4483-8dc3-bb8ebb67be06 tempest-AttachInterfacesTestJSON-2140085841 tempest-AttachInterfacesTestJSON-2140085841-project-member] Enqueued Resource ID: 32ffe6c8-3c43-4477-ba28-405c32ea0087 with Priority: HIGHEST for action security_group_rules [ 1039.270941] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32ffe6c8-3c43-4477-ba28-405c32ea0087 with Priority: HIGHEST for action security_group_rules [ 1039.272547] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32ffe6c8-3c43-4477-ba28-405c32ea0087 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.272801] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32ffe6c8-3c43-4477-ba28-405c32ea0087" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.272801] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32ffe6c8-3c43-4477-ba28-405c32ea0087" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.273611] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32ffe6c8-3c43-4477-ba28-405c32ea0087" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.273611] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32ffe6c8-3c43-4477-ba28-405c32ea0087',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.418088] env[62842]: INFO networking_nsxv3.common.synchronization [None req-214b9f54-5e19-4a65-9905-abe6ae84f015 tempest-AttachInterfacesTestJSON-2140085841 tempest-AttachInterfacesTestJSON-2140085841-project-member] Enqueued Resource ID: 32ffe6c8-3c43-4477-ba28-405c32ea0087 with Priority: HIGHEST for action security_group_rules [ 1039.418834] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32ffe6c8-3c43-4477-ba28-405c32ea0087 with Priority: HIGHEST for action security_group_rules [ 1039.419180] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32ffe6c8-3c43-4477-ba28-405c32ea0087 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.419282] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32ffe6c8-3c43-4477-ba28-405c32ea0087" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.479290] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.479462] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.479535] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.479975] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.480079] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.480181] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 is going to be updated. [ 1039.519293] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.519530] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.519943] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.519943] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.520062] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.533108] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 in Status: IN_PROGRESS for 2s [ 1039.797501] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.797698] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.797698] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.797907] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.797995] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.798102] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32ffe6c8-3c43-4477-ba28-405c32ea0087 already deleted. [ 1039.798186] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32ffe6c8-3c43-4477-ba28-405c32ea0087" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.798339] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32ffe6c8-3c43-4477-ba28-405c32ea0087" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.798499] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32ffe6c8-3c43-4477-ba28-405c32ea0087" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.798584] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32ffe6c8-3c43-4477-ba28-405c32ea0087',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.323203] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.323851] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.323851] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.323851] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.323851] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.323851] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32ffe6c8-3c43-4477-ba28-405c32ea0087 already deleted. [ 1040.323851] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32ffe6c8-3c43-4477-ba28-405c32ea0087" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.458963] env[62842]: INFO networking_nsxv3.common.synchronization [req-be3394fa-fc54-4117-a590-a65221504d1e req-12d6d18c-f05e-41fc-9f06-06b2f50fb8c5 service nova] Enqueued Resource ID: 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 with Priority: HIGHEST for action security_group_rules [ 1040.459236] env[62842]: INFO networking_nsxv3.common.synchronization [req-be3394fa-fc54-4117-a590-a65221504d1e req-12d6d18c-f05e-41fc-9f06-06b2f50fb8c5 service nova] Enqueued Resource ID: 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 with Priority: HIGHEST for action security_group_members [ 1040.459405] env[62842]: INFO networking_nsxv3.common.synchronization [req-be3394fa-fc54-4117-a590-a65221504d1e req-12d6d18c-f05e-41fc-9f06-06b2f50fb8c5 service nova] Enqueued Resource ID: 5aee4f25-0316-43bf-8a85-0a6dafd32df8 with Priority: HIGHEST for action port [ 1040.460079] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 with Priority: HIGHEST for action security_group_rules [ 1040.460234] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 with Priority: HIGHEST for action security_group_members [ 1040.460343] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5aee4f25-0316-43bf-8a85-0a6dafd32df8 with Priority: HIGHEST for action port [ 1040.460647] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.460777] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.460835] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.461041] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.461124] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.465203] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.465334] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.465520] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-5aee4f25-0316-43bf-8a85-0a6dafd32df8 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.465617] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5aee4f25-0316-43bf-8a85-0a6dafd32df8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.465679] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5aee4f25-0316-43bf-8a85-0a6dafd32df8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.465873] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5aee4f25-0316-43bf-8a85-0a6dafd32df8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.466609] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5aee4f25-0316-43bf-8a85-0a6dafd32df8',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.606835] env[62842]: INFO networking_nsxv3.common.synchronization [req-21f9604d-5a90-4131-b44a-e310286f995e req-d82aae52-5a99-4c21-8bea-548c3bd9817d tempest-AttachVolumeShelveTestJSON-759972748 tempest-AttachVolumeShelveTestJSON-759972748-project-member] Enqueued Resource ID: 15e06d0a-ad75-4e9d-b1a6-db54b2f524a4 with Priority: HIGHEST for action security_group_members [ 1040.607329] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15e06d0a-ad75-4e9d-b1a6-db54b2f524a4 with Priority: HIGHEST for action security_group_members [ 1040.607656] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.607812] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.607916] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.608197] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.608421] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.608538] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.608601] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.608840] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.608951] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.609060] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15e06d0a-ad75-4e9d-b1a6-db54b2f524a4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.969164] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.969524] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.969877] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5aee4f25-0316-43bf-8a85-0a6dafd32df8 with status ACTIVE [ 1040.973024] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.973024] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.973024] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.973024] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.973024] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.973024] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.973024] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.973024] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.973024] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.973024] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.973024] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.973024] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.973024] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.973024] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.973024] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.973024] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5aee4f25-0316-43bf-8a85-0a6dafd32df8 is going to be updated. [ 1040.996749] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.996975] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.996975] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.997190] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.997327] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.997488] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5aee4f25-0316-43bf-8a85-0a6dafd32df8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.114261] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.114261] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.114261] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.114261] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.114261] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.114261] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.114261] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.114261] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.114261] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.114261] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.114261] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15e06d0a-ad75-4e9d-b1a6-db54b2f524a4 is going to be updated. [ 1041.146523] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.146709] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.146745] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.146952] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.147107] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.157143] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15e06d0a-ad75-4e9d-b1a6-db54b2f524a4 in Status: IN_PROGRESS for 2s [ 1041.543774] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 in Status: SUCCESS [ 1041.544135] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.544221] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.544499] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.544717] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.544968] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.544968] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.545070] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.545153] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.545247] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.048428] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.550557] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.052598] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.052811] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.052869] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.053121] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.053212] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.053317] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 is going to be updated. [ 1043.086350] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.086554] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.086554] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.086708] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.086853] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.096559] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 in Status: IN_PROGRESS for 2s [ 1043.167417] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15e06d0a-ad75-4e9d-b1a6-db54b2f524a4 in Status: SUCCESS [ 1043.167610] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15e06d0a-ad75-4e9d-b1a6-db54b2f524a4 deletion is rescheduled due to dependency. [ 1043.167752] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.884324] env[62842]: INFO networking_nsxv3.common.synchronization [req-edc0c5e1-a93a-4bf1-98dc-9c5bb8d32e77 req-90159fd4-59c9-4cb0-bcd8-d90785365b16 tempest-ServerPasswordTestJSON-1985920430 tempest-ServerPasswordTestJSON-1985920430-project-member] Enqueued Resource ID: 789b6627-9a06-47bb-b607-d6625f262f66 with Priority: HIGHEST for action security_group_members [ 1043.884915] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 789b6627-9a06-47bb-b607-d6625f262f66 with Priority: HIGHEST for action security_group_members [ 1043.885124] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-789b6627-9a06-47bb-b607-d6625f262f66 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.885272] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-789b6627-9a06-47bb-b607-d6625f262f66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.885350] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-789b6627-9a06-47bb-b607-d6625f262f66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.885553] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-789b6627-9a06-47bb-b607-d6625f262f66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.885804] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.885854] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.885912] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.886067] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.886877] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.886877] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('789b6627-9a06-47bb-b607-d6625f262f66',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.393065] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.393245] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.393317] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.393606] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.393728] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.393950] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.394058] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.394121] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.394400] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.394400] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.394511] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 789b6627-9a06-47bb-b607-d6625f262f66 is going to be updated. [ 1044.429541] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.429794] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.429794] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.430027] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.430187] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.442975] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 789b6627-9a06-47bb-b607-d6625f262f66 in Status: IN_PROGRESS for 2s [ 1045.111864] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 in Status: SUCCESS [ 1045.112142] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.112286] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.112505] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.112708] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.112856] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.112896] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.113096] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.113133] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.113218] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.113310] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.619213] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.122252] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393: rpc.has_security_group_logging(os_id): False [ 1046.142275] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.142450] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.142493] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.142726] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.142832] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.143083] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.143184] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.143247] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.143390] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.143466] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.143552] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 is going to be updated. [ 1046.210126] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.210339] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.210389] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.210571] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.210717] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.231610] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 in Status: IN_PROGRESS for 2s [ 1046.454223] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 789b6627-9a06-47bb-b607-d6625f262f66 in Status: SUCCESS [ 1046.454460] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 789b6627-9a06-47bb-b607-d6625f262f66 deletion is rescheduled due to dependency. [ 1046.454550] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-789b6627-9a06-47bb-b607-d6625f262f66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.759130] env[62842]: INFO networking_nsxv3.common.synchronization [req-4fd9f76a-88e0-404b-aa08-3e47117c53e7 req-d9376308-d131-40c3-9e5c-33962627d71f tempest-ImagesTestJSON-1786483082 tempest-ImagesTestJSON-1786483082-project-member] Enqueued Resource ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 with Priority: HIGHEST for action security_group_members [ 1047.759759] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 with Priority: HIGHEST for action security_group_members [ 1047.760077] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e26630c-b3f7-4b48-9720-77b59135adf4 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.760196] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.760260] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.760449] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.760598] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.760690] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.760750] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.760891] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.760972] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.761076] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e26630c-b3f7-4b48-9720-77b59135adf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.097997] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-41 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.098213] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-41" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.098341] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-41" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.098646] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-41" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.098927] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.099100] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.099221] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.099477] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.099629] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.099843] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1048.099960] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1048.100086] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1048.100201] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1048.100311] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1048.100421] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1048.100556] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1048.119691] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1048.119945] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1048.120069] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1048.120187] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-41" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.120506] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-d7606de6-2efe-4d48-b284-02f787132a71 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.120688] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-d7606de6-2efe-4d48-b284-02f787132a71" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.120791] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-d7606de6-2efe-4d48-b284-02f787132a71" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.121177] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-d7606de6-2efe-4d48-b284-02f787132a71" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.121321] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7606de6-2efe-4d48-b284-02f787132a71',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.247982] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 in Status: SUCCESS [ 1048.248233] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.264085] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.264288] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.264288] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.264582] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.264712] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.264944] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.265065] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.265137] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.265303] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.265384] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.265471] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 is going to be updated. [ 1048.294291] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.294507] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.294558] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.294869] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.295057] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.306248] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 in Status: IN_PROGRESS for 2s [ 1048.624208] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.624481] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.624681] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.625018] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.625218] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.625411] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port d7606de6-2efe-4d48-b284-02f787132a71 not found, creating... [ 1048.625709] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.625881] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.626069] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.626260] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.626403] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.626701] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.626862] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.626984] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.627217] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.627356] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.627506] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: d7606de6-2efe-4d48-b284-02f787132a71 is going to be created. [ 1048.650265] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.650565] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.650820] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.651205] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.651513] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.651756] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-d7606de6-2efe-4d48-b284-02f787132a71" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.421702] env[62842]: INFO networking_nsxv3.common.synchronization [req-4fd9f76a-88e0-404b-aa08-3e47117c53e7 req-e1f647f4-ac90-4c8c-8155-d6e793766ebe service nova] Enqueued Resource ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 with Priority: HIGHEST for action security_group_rules [ 1049.421702] env[62842]: INFO networking_nsxv3.common.synchronization [req-4fd9f76a-88e0-404b-aa08-3e47117c53e7 req-e1f647f4-ac90-4c8c-8155-d6e793766ebe service nova] Enqueued Resource ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 with Priority: HIGHEST for action security_group_members [ 1049.421702] env[62842]: INFO networking_nsxv3.common.synchronization [req-4fd9f76a-88e0-404b-aa08-3e47117c53e7 req-e1f647f4-ac90-4c8c-8155-d6e793766ebe service nova] Enqueued Resource ID: d7606de6-2efe-4d48-b284-02f787132a71 with Priority: HIGHEST for action port [ 1049.422249] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 with Priority: HIGHEST for action security_group_rules [ 1049.422249] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 with Priority: HIGHEST for action security_group_members [ 1049.422249] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7606de6-2efe-4d48-b284-02f787132a71 with Priority: HIGHEST for action port [ 1049.422561] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e26630c-b3f7-4b48-9720-77b59135adf4 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.422712] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.422783] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.423018] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.423125] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e26630c-b3f7-4b48-9720-77b59135adf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.424059] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e26630c-b3f7-4b48-9720-77b59135adf4 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.424168] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.427499] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7606de6-2efe-4d48-b284-02f787132a71 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.427499] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7606de6-2efe-4d48-b284-02f787132a71" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.427499] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7606de6-2efe-4d48-b284-02f787132a71" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.427499] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7606de6-2efe-4d48-b284-02f787132a71" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.427499] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7606de6-2efe-4d48-b284-02f787132a71',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.926585] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e26630c-b3f7-4b48-9720-77b59135adf4 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.926818] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.926926] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d7606de6-2efe-4d48-b284-02f787132a71 with status ACTIVE [ 1049.927090] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.927199] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.927263] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.927481] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.927611] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.927745] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.928059] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.928059] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.928228] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.928228] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.928374] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.928466] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.928537] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.928698] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.928774] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.929284] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d7606de6-2efe-4d48-b284-02f787132a71 is going to be updated. [ 1049.952972] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.953144] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.953224] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.953400] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.953534] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.953695] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7606de6-2efe-4d48-b284-02f787132a71" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.315760] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 in Status: SUCCESS [ 1050.316068] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 deletion is rescheduled due to dependency. [ 1050.316252] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.316501] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.316837] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.317132] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.317326] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.317436] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.317643] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.317774] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.317921] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e26630c-b3f7-4b48-9720-77b59135adf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.820954] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e26630c-b3f7-4b48-9720-77b59135adf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.323913] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e26630c-b3f7-4b48-9720-77b59135adf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.826829] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.827325] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.827325] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.827464] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.827464] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.827582] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 is going to be updated. [ 1051.863415] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.863585] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.863634] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.864164] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.864347] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.885355] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 in Status: IN_PROGRESS for 2s [ 1053.540250] env[62842]: INFO networking_nsxv3.common.synchronization [req-6d737dee-66ee-45ef-bde1-fa1ab6dedb85 req-cc7ed55f-0d68-4c19-981c-00e9cba512c2 tempest-AttachVolumeNegativeTest-1420230652 tempest-AttachVolumeNegativeTest-1420230652-project-member] Enqueued Resource ID: c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311 with Priority: HIGHEST for action security_group_members [ 1053.540250] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311 with Priority: HIGHEST for action security_group_members [ 1053.540250] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.540250] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.540250] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.540250] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.540714] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.540714] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.540714] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.541319] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.541319] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.541319] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.898974] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 in Status: SUCCESS [ 1053.899216] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.899384] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.899599] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.899794] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.899912] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.899975] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.900140] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.900223] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.900309] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.900398] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3e26630c-b3f7-4b48-9720-77b59135adf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.046231] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.046231] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.046231] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.046231] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.046231] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.046231] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.046231] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.046231] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.046231] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.046231] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.046231] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311 is going to be updated. [ 1054.072101] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.072266] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.072310] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.072534] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.072690] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.082013] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311 in Status: IN_PROGRESS for 2s [ 1054.402217] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e26630c-b3f7-4b48-9720-77b59135adf4 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.402406] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.402508] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.403712] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.403712] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.403712] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.403712] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.403712] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.403712] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.403712] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.403712] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e26630c-b3f7-4b48-9720-77b59135adf4 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.403712] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.403712] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.404214] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.404301] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.405788] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.405788] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.405788] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.405788] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.405788] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.405788] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3e26630c-b3f7-4b48-9720-77b59135adf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.768638] env[62842]: INFO networking_nsxv3.common.synchronization [req-d4a5b2fc-0109-4dec-b7f4-44c9030e0b92 req-851908bb-3bef-4214-8ed5-3bbc6f050ee8 tempest-MultipleCreateTestJSON-1704086459 tempest-MultipleCreateTestJSON-1704086459-project-member] Enqueued Resource ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 with Priority: HIGHEST for action security_group_members [ 1054.769206] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 with Priority: HIGHEST for action security_group_members [ 1054.769581] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-29a28398-6e5b-4a4f-81e9-a2f458468c19 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.769705] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.769776] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.770016] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.770184] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.770302] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.770371] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.770525] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.770610] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.770702] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29a28398-6e5b-4a4f-81e9-a2f458468c19',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.910409] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3e26630c-b3f7-4b48-9720-77b59135adf4: rpc.has_security_group_logging(os_id): False [ 1054.932168] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.932604] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.932604] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.933050] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.933050] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.933050] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.933684] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.933684] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.933684] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.933684] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.933684] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.933684] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.933974] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.933974] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.933974] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.934600] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.935300] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.935300] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.935300] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.935300] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.935300] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 is going to be updated. [ 1054.997824] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.998020] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.998064] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.998248] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.998395] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.010481] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 in Status: IN_PROGRESS for 2s [ 1055.155090] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-180 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.155205] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-180" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.155414] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-180" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.155889] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-180" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.156361] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.156639] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.156852] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.157139] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.157319] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.157565] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1055.157916] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1055.157916] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1055.158059] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1055.158182] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1055.158343] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1055.159524] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1055.178454] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1055.178704] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1055.178704] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1055.178886] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-180" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.179191] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-4155ceb8-e2be-44e4-a762-8a46cd8d9e17 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.179389] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-4155ceb8-e2be-44e4-a762-8a46cd8d9e17" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.179528] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-4155ceb8-e2be-44e4-a762-8a46cd8d9e17" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.179884] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-4155ceb8-e2be-44e4-a762-8a46cd8d9e17" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.180045] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4155ceb8-e2be-44e4-a762-8a46cd8d9e17',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.272790] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.272978] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.273079] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.273347] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.273451] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.273712] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.273845] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.273939] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.274160] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.274286] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.274425] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 is going to be updated. [ 1055.312102] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.312102] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.312102] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.312355] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.312424] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.327827] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 in Status: IN_PROGRESS for 2s [ 1055.684509] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.684509] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.684509] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.684509] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.684509] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.684509] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 4155ceb8-e2be-44e4-a762-8a46cd8d9e17 not found, creating... [ 1055.684509] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.684509] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.684509] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.684509] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.684509] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.685088] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.685088] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.685169] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.686052] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.686052] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.686052] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 4155ceb8-e2be-44e4-a762-8a46cd8d9e17 is going to be created. [ 1055.708739] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.708972] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.709080] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.709804] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.710104] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.710340] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-4155ceb8-e2be-44e4-a762-8a46cd8d9e17" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.092966] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311 in Status: SUCCESS [ 1056.093313] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311 deletion is rescheduled due to dependency. [ 1056.093348] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.421753] env[62842]: INFO networking_nsxv3.common.synchronization [req-d4a5b2fc-0109-4dec-b7f4-44c9030e0b92 req-0060b06d-d127-4e3b-9460-8fa5b7bade3e service nova] Enqueued Resource ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 with Priority: HIGHEST for action security_group_rules [ 1056.422212] env[62842]: INFO networking_nsxv3.common.synchronization [req-d4a5b2fc-0109-4dec-b7f4-44c9030e0b92 req-0060b06d-d127-4e3b-9460-8fa5b7bade3e service nova] Enqueued Resource ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 with Priority: HIGHEST for action security_group_members [ 1056.422283] env[62842]: INFO networking_nsxv3.common.synchronization [req-d4a5b2fc-0109-4dec-b7f4-44c9030e0b92 req-0060b06d-d127-4e3b-9460-8fa5b7bade3e service nova] Enqueued Resource ID: 4155ceb8-e2be-44e4-a762-8a46cd8d9e17 with Priority: HIGHEST for action port [ 1056.422926] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 with Priority: HIGHEST for action security_group_rules [ 1056.423630] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 with Priority: HIGHEST for action security_group_members [ 1056.423753] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4155ceb8-e2be-44e4-a762-8a46cd8d9e17 with Priority: HIGHEST for action port [ 1056.424155] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-29a28398-6e5b-4a4f-81e9-a2f458468c19 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.424253] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.425014] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.425158] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.425289] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('29a28398-6e5b-4a4f-81e9-a2f458468c19',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.426196] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-29a28398-6e5b-4a4f-81e9-a2f458468c19 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.426330] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.426570] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-4155ceb8-e2be-44e4-a762-8a46cd8d9e17 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.426705] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4155ceb8-e2be-44e4-a762-8a46cd8d9e17" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.426794] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4155ceb8-e2be-44e4-a762-8a46cd8d9e17" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.427518] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4155ceb8-e2be-44e4-a762-8a46cd8d9e17" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.427518] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4155ceb8-e2be-44e4-a762-8a46cd8d9e17',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.929675] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-29a28398-6e5b-4a4f-81e9-a2f458468c19 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.929867] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.930052] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4155ceb8-e2be-44e4-a762-8a46cd8d9e17 with status ACTIVE [ 1056.932038] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.932038] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.932038] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.932038] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.932038] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.932038] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.932038] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.932038] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.932038] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.932038] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.932038] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.932038] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.932038] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.932768] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.932768] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.932768] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4155ceb8-e2be-44e4-a762-8a46cd8d9e17 is going to be updated. [ 1056.969534] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.969698] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.969698] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.969956] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.970153] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.970314] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4155ceb8-e2be-44e4-a762-8a46cd8d9e17" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.048646] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 in Status: SUCCESS [ 1057.048646] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.339745] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 in Status: SUCCESS [ 1057.340132] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 deletion is rescheduled due to dependency. [ 1057.340132] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.340214] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.340433] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.340621] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.340733] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.340806] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.340944] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.341036] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.341131] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29a28398-6e5b-4a4f-81e9-a2f458468c19',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.353722] env[62842]: INFO networking_nsxv3.common.synchronization [req-d4a5b2fc-0109-4dec-b7f4-44c9030e0b92 req-579655ca-d79a-4dc6-ba9e-6edb02bb4a8a tempest-MultipleCreateTestJSON-1704086459 tempest-MultipleCreateTestJSON-1704086459-project-member] Enqueued Resource ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 with Priority: HIGHEST for action security_group_members [ 1057.354262] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 with Priority: HIGHEST for action security_group_members [ 1057.354585] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-29a28398-6e5b-4a4f-81e9-a2f458468c19 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.354969] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.843648] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('29a28398-6e5b-4a4f-81e9-a2f458468c19',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.056395] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-180 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.056676] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-180" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.056801] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-180" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.057127] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-180" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.057419] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.057665] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.057819] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.058090] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.058249] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.058468] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1058.058618] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1058.058737] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1058.058874] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1058.059073] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1058.059336] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1058.059576] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1058.080750] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1058.081147] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1058.081465] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1058.081827] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-180" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.082537] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-c7de73f8-e332-4659-be2e-59542be3182d taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.083120] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-c7de73f8-e332-4659-be2e-59542be3182d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.083348] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-c7de73f8-e332-4659-be2e-59542be3182d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.083869] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-c7de73f8-e332-4659-be2e-59542be3182d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.084207] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c7de73f8-e332-4659-be2e-59542be3182d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.349153] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('29a28398-6e5b-4a4f-81e9-a2f458468c19',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.590026] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.590026] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.590026] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.590026] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.590026] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.590026] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port c7de73f8-e332-4659-be2e-59542be3182d not found, creating... [ 1058.590026] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.590026] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.590026] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.590026] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.590683] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.591130] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.591447] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.591792] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.592146] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.592403] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.592661] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: c7de73f8-e332-4659-be2e-59542be3182d is going to be created. [ 1058.619970] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.620231] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.620313] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.620604] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.620850] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.621097] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-c7de73f8-e332-4659-be2e-59542be3182d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.852869] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.853067] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.853109] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.853292] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.853386] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.853484] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 is going to be updated. [ 1058.885971] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.886126] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.886196] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.886620] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.886620] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.896707] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 in Status: IN_PROGRESS for 2s [ 1059.899956] env[62842]: INFO networking_nsxv3.common.synchronization [req-d4a5b2fc-0109-4dec-b7f4-44c9030e0b92 req-4f117c4f-0f5f-4c9f-a0d9-5fde17af9880 service nova] Enqueued Resource ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 with Priority: HIGHEST for action security_group_rules [ 1059.900281] env[62842]: INFO networking_nsxv3.common.synchronization [req-d4a5b2fc-0109-4dec-b7f4-44c9030e0b92 req-4f117c4f-0f5f-4c9f-a0d9-5fde17af9880 service nova] Enqueued Resource ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 with Priority: HIGHEST for action security_group_members [ 1059.900322] env[62842]: INFO networking_nsxv3.common.synchronization [req-d4a5b2fc-0109-4dec-b7f4-44c9030e0b92 req-4f117c4f-0f5f-4c9f-a0d9-5fde17af9880 service nova] Enqueued Resource ID: c7de73f8-e332-4659-be2e-59542be3182d with Priority: HIGHEST for action port [ 1059.900550] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 with Priority: HIGHEST for action security_group_rules [ 1059.900694] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 with Priority: HIGHEST for action security_group_members [ 1059.900792] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7de73f8-e332-4659-be2e-59542be3182d with Priority: HIGHEST for action port [ 1059.901478] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-29a28398-6e5b-4a4f-81e9-a2f458468c19 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.901646] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.901958] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-29a28398-6e5b-4a4f-81e9-a2f458468c19 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.902118] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.902389] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-c7de73f8-e332-4659-be2e-59542be3182d taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.902538] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c7de73f8-e332-4659-be2e-59542be3182d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.902616] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c7de73f8-e332-4659-be2e-59542be3182d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.902854] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c7de73f8-e332-4659-be2e-59542be3182d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.902979] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c7de73f8-e332-4659-be2e-59542be3182d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.405729] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c7de73f8-e332-4659-be2e-59542be3182d with status ACTIVE [ 1060.405970] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.406130] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.406201] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.406415] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.406503] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.406685] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.406782] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.406841] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.406983] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.407072] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.407250] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.407342] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.407404] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.407546] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.407616] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.407694] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c7de73f8-e332-4659-be2e-59542be3182d is going to be updated. [ 1060.431615] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.431877] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.432124] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.432661] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.432661] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.432765] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c7de73f8-e332-4659-be2e-59542be3182d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.911022] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 in Status: SUCCESS [ 1060.911022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.911022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.911022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.911022] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.911022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.911022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.911022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.911022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.911022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.911022] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('29a28398-6e5b-4a4f-81e9-a2f458468c19',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.912820] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.913170] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.913495] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.913770] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.913949] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.914231] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.914432] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.914690] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29a28398-6e5b-4a4f-81e9-a2f458468c19',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.417531] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-29a28398-6e5b-4a4f-81e9-a2f458468c19 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.417743] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.417855] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('29a28398-6e5b-4a4f-81e9-a2f458468c19',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.920016] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('29a28398-6e5b-4a4f-81e9-a2f458468c19',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.423356] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.423803] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.423803] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.424019] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.424771] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.425382] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 is going to be updated. [ 1062.459329] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.459543] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.459543] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.459809] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.459934] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.469580] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 in Status: IN_PROGRESS for 2s [ 1064.483886] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 in Status: SUCCESS [ 1064.483886] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.483886] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.483886] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.483886] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.483886] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.483886] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.483886] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.483886] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.483886] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29a28398-6e5b-4a4f-81e9-a2f458468c19',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.814047] env[62842]: INFO networking_nsxv3.common.synchronization [req-4d5cdad8-eeba-431b-b36c-99ff169eb803 req-7c2014c5-40a6-412a-af8a-d7ac4bd8ed21 tempest-AttachInterfacesTestJSON-2140085841 tempest-AttachInterfacesTestJSON-2140085841-project-member] Enqueued Resource ID: 32ffe6c8-3c43-4477-ba28-405c32ea0087 with Priority: HIGHEST for action security_group_members [ 1064.814345] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32ffe6c8-3c43-4477-ba28-405c32ea0087 with Priority: HIGHEST for action security_group_members [ 1064.814838] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-32ffe6c8-3c43-4477-ba28-405c32ea0087 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.814838] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32ffe6c8-3c43-4477-ba28-405c32ea0087" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.814940] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32ffe6c8-3c43-4477-ba28-405c32ea0087" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.815144] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32ffe6c8-3c43-4477-ba28-405c32ea0087" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.815299] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.815400] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.815460] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.815656] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.815693] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.815771] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32ffe6c8-3c43-4477-ba28-405c32ea0087',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.987831] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('29a28398-6e5b-4a4f-81e9-a2f458468c19',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.290764] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-416 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.290987] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-416" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.291138] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-416" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.291408] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-416" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.291705] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.291892] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.292327] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.292785] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.292917] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.293204] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1065.293396] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1065.293565] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1065.293726] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1065.293895] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1065.294025] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1065.294290] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1065.314858] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1065.315059] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1065.315219] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1065.315407] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-416" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.315755] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-048d0a56-7c23-4247-8910-7ea0a74cd865 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.315943] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-048d0a56-7c23-4247-8910-7ea0a74cd865" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.316080] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-048d0a56-7c23-4247-8910-7ea0a74cd865" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.316463] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-048d0a56-7c23-4247-8910-7ea0a74cd865" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.316611] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('048d0a56-7c23-4247-8910-7ea0a74cd865',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.322509] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.322720] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.323110] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.323355] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.323482] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.323717] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.323869] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.323963] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.324181] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.324335] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.324478] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32ffe6c8-3c43-4477-ba28-405c32ea0087 already deleted. [ 1065.324605] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32ffe6c8-3c43-4477-ba28-405c32ea0087" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.490855] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('29a28398-6e5b-4a4f-81e9-a2f458468c19',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.819651] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.819887] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.820031] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.820325] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.820481] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.820675] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 048d0a56-7c23-4247-8910-7ea0a74cd865 not found, creating... [ 1065.820946] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.821147] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.821281] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.821526] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.821708] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.822014] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.822185] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.822307] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.822515] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.822684] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.822826] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 048d0a56-7c23-4247-8910-7ea0a74cd865 is going to be created. [ 1065.843628] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.843920] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.844059] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.844320] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.844554] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.844782] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-048d0a56-7c23-4247-8910-7ea0a74cd865" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.993704] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.993895] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.993947] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.994256] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.994370] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.994480] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 is going to be updated. [ 1066.055145] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.055145] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.055145] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.055145] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.055145] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.063782] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 in Status: IN_PROGRESS for 2s [ 1066.821736] env[62842]: INFO networking_nsxv3.common.synchronization [req-4d5cdad8-eeba-431b-b36c-99ff169eb803 req-a83f8101-c0d7-4ece-9159-2795b3306190 service nova] Enqueued Resource ID: 32ffe6c8-3c43-4477-ba28-405c32ea0087 with Priority: HIGHEST for action security_group_rules [ 1066.822109] env[62842]: INFO networking_nsxv3.common.synchronization [req-4d5cdad8-eeba-431b-b36c-99ff169eb803 req-a83f8101-c0d7-4ece-9159-2795b3306190 service nova] Enqueued Resource ID: 32ffe6c8-3c43-4477-ba28-405c32ea0087 with Priority: HIGHEST for action security_group_members [ 1066.822250] env[62842]: INFO networking_nsxv3.common.synchronization [req-4d5cdad8-eeba-431b-b36c-99ff169eb803 req-a83f8101-c0d7-4ece-9159-2795b3306190 service nova] Enqueued Resource ID: 048d0a56-7c23-4247-8910-7ea0a74cd865 with Priority: HIGHEST for action port [ 1066.822903] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32ffe6c8-3c43-4477-ba28-405c32ea0087 with Priority: HIGHEST for action security_group_rules [ 1066.822997] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32ffe6c8-3c43-4477-ba28-405c32ea0087 with Priority: HIGHEST for action security_group_members [ 1066.823662] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 048d0a56-7c23-4247-8910-7ea0a74cd865 with Priority: HIGHEST for action port [ 1066.823662] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32ffe6c8-3c43-4477-ba28-405c32ea0087 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.823662] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32ffe6c8-3c43-4477-ba28-405c32ea0087" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.823810] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32ffe6c8-3c43-4477-ba28-405c32ea0087" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.823887] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32ffe6c8-3c43-4477-ba28-405c32ea0087" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.824025] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32ffe6c8-3c43-4477-ba28-405c32ea0087',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.825125] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-32ffe6c8-3c43-4477-ba28-405c32ea0087 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.825205] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32ffe6c8-3c43-4477-ba28-405c32ea0087" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.825248] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32ffe6c8-3c43-4477-ba28-405c32ea0087" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.825453] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32ffe6c8-3c43-4477-ba28-405c32ea0087" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.825653] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.825819] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.825850] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.826093] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.826222] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.826342] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32ffe6c8-3c43-4477-ba28-405c32ea0087',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.827576] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-048d0a56-7c23-4247-8910-7ea0a74cd865 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.827733] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-048d0a56-7c23-4247-8910-7ea0a74cd865" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.827850] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-048d0a56-7c23-4247-8910-7ea0a74cd865" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.828072] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-048d0a56-7c23-4247-8910-7ea0a74cd865" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.828185] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('048d0a56-7c23-4247-8910-7ea0a74cd865',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.336229] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-32ffe6c8-3c43-4477-ba28-405c32ea0087 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.336229] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32ffe6c8-3c43-4477-ba28-405c32ea0087" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.336229] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('32ffe6c8-3c43-4477-ba28-405c32ea0087',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.336229] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 048d0a56-7c23-4247-8910-7ea0a74cd865 with status ACTIVE [ 1067.336229] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.336229] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.336229] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.336551] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.336551] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.337140] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.337140] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.337140] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.337354] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.337354] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.337467] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.337693] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.337693] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.337879] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.337917] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.338146] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 048d0a56-7c23-4247-8910-7ea0a74cd865 is going to be updated. [ 1067.370445] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.370736] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.370736] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.370897] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.371051] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.371224] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-048d0a56-7c23-4247-8910-7ea0a74cd865" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.840621] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('32ffe6c8-3c43-4477-ba28-405c32ea0087',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.080196] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 in Status: SUCCESS [ 1068.080196] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.080196] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.080196] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.080196] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.080196] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.080196] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.080196] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.080196] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.080196] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.080196] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-29a28398-6e5b-4a4f-81e9-a2f458468c19 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.080196] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.080196] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.080196] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.080196] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.080196] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.080196] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.080196] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.080196] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.080899] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.080899] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('29a28398-6e5b-4a4f-81e9-a2f458468c19',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.343367] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.343584] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.343688] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.344060] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.344457] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.344457] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32ffe6c8-3c43-4477-ba28-405c32ea0087 is going to be created. [ 1068.374764] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.374991] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.375053] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.375328] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.375548] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.387114] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32ffe6c8-3c43-4477-ba28-405c32ea0087 in Status: UNINITIALIZED for 2s [ 1068.583608] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 29a28398-6e5b-4a4f-81e9-a2f458468c19: rpc.has_security_group_logging(os_id): False [ 1068.604780] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.604934] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.605021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.605238] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.605333] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.605529] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.605621] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.605709] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.605857] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.605918] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.606115] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.606220] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.606282] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.606483] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.606532] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.606713] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.606815] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.606936] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.607533] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.607666] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.607819] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 is going to be updated. [ 1068.704814] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.705042] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.705042] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.705291] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.705472] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.722137] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 in Status: IN_PROGRESS for 2s [ 1069.449153] env[62842]: INFO networking_nsxv3.common.synchronization [req-8e11a889-95f9-41f7-9ac7-7ba859d730f9 req-e0cff7b5-55a0-49a9-9d0b-6906bf84a5b3 tempest-ServersTestJSON-1267616671 tempest-ServersTestJSON-1267616671-project-member] Enqueued Resource ID: 074be4e0-ffc9-4ec9-b29a-40406844218c with Priority: HIGHEST for action security_group_members [ 1069.449971] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 074be4e0-ffc9-4ec9-b29a-40406844218c with Priority: HIGHEST for action security_group_members [ 1069.450447] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-074be4e0-ffc9-4ec9-b29a-40406844218c taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.450614] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.450732] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.451009] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.451243] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.451432] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.451539] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.451823] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.451952] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.452121] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.909324] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-509 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.909792] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-509" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.909925] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-509" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.910251] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-509" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.910533] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.910699] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.910837] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.911109] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.911267] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.911482] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1069.911775] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1069.911964] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1069.912106] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1069.912232] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1069.912347] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1069.912490] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1069.932936] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1069.933224] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1069.933392] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1069.933583] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-509" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.934018] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-5708554b-66be-41cb-8273-06b19f9a9ad4 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.934262] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-5708554b-66be-41cb-8273-06b19f9a9ad4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.934418] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-5708554b-66be-41cb-8273-06b19f9a9ad4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.934766] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-5708554b-66be-41cb-8273-06b19f9a9ad4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.934924] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5708554b-66be-41cb-8273-06b19f9a9ad4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.956228] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.399051] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32ffe6c8-3c43-4477-ba28-405c32ea0087 in Status: SUCCESS [ 1070.399361] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32ffe6c8-3c43-4477-ba28-405c32ea0087" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.399561] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32ffe6c8-3c43-4477-ba28-405c32ea0087" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.399884] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32ffe6c8-3c43-4477-ba28-405c32ea0087" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.400143] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.400294] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.400367] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.400570] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.400652] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.400783] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32ffe6c8-3c43-4477-ba28-405c32ea0087" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.400912] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('32ffe6c8-3c43-4477-ba28-405c32ea0087',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.437826] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.438090] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.438222] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.438549] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.438780] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.438996] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 5708554b-66be-41cb-8273-06b19f9a9ad4 not found, creating... [ 1070.439315] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.439522] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.439653] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.439906] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.440080] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.440433] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.440704] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.440847] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.441105] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.441248] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.441420] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 5708554b-66be-41cb-8273-06b19f9a9ad4 is going to be created. [ 1070.458426] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.466781] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.467023] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.467260] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.467461] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.467711] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.467955] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-5708554b-66be-41cb-8273-06b19f9a9ad4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.734702] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 in Status: SUCCESS [ 1070.734926] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.735158] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.735385] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.735476] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('29a28398-6e5b-4a4f-81e9-a2f458468c19',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.903470] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('32ffe6c8-3c43-4477-ba28-405c32ea0087',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.961911] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.962080] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.962128] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.962303] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.962392] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.962515] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 074be4e0-ffc9-4ec9-b29a-40406844218c is going to be updated. [ 1071.022985] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.023153] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.023224] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.024033] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.024033] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.055857] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 074be4e0-ffc9-4ec9-b29a-40406844218c in Status: IN_PROGRESS for 2s [ 1071.238051] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-29a28398-6e5b-4a4f-81e9-a2f458468c19 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.238278] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.238354] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.238599] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.238841] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.238987] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.239086] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.239294] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.239397] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.239493] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.239587] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('29a28398-6e5b-4a4f-81e9-a2f458468c19',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.272642] env[62842]: INFO networking_nsxv3.common.synchronization [req-8e11a889-95f9-41f7-9ac7-7ba859d730f9 req-85add298-2a33-4f16-ab7d-197a7a6f089d service nova] Enqueued Resource ID: 074be4e0-ffc9-4ec9-b29a-40406844218c with Priority: HIGHEST for action security_group_rules [ 1071.272901] env[62842]: INFO networking_nsxv3.common.synchronization [req-8e11a889-95f9-41f7-9ac7-7ba859d730f9 req-85add298-2a33-4f16-ab7d-197a7a6f089d service nova] Enqueued Resource ID: 074be4e0-ffc9-4ec9-b29a-40406844218c with Priority: HIGHEST for action security_group_members [ 1071.273066] env[62842]: INFO networking_nsxv3.common.synchronization [req-8e11a889-95f9-41f7-9ac7-7ba859d730f9 req-85add298-2a33-4f16-ab7d-197a7a6f089d service nova] Enqueued Resource ID: 5708554b-66be-41cb-8273-06b19f9a9ad4 with Priority: HIGHEST for action port [ 1071.273587] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 074be4e0-ffc9-4ec9-b29a-40406844218c with Priority: HIGHEST for action security_group_rules [ 1071.273683] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 074be4e0-ffc9-4ec9-b29a-40406844218c with Priority: HIGHEST for action security_group_members [ 1071.273783] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5708554b-66be-41cb-8273-06b19f9a9ad4 with Priority: HIGHEST for action port [ 1071.275559] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-074be4e0-ffc9-4ec9-b29a-40406844218c taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.276087] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.276087] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.276087] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.276087] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.278333] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-074be4e0-ffc9-4ec9-b29a-40406844218c taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.279107] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.279828] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-5708554b-66be-41cb-8273-06b19f9a9ad4 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.279828] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5708554b-66be-41cb-8273-06b19f9a9ad4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.279828] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5708554b-66be-41cb-8273-06b19f9a9ad4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.280069] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5708554b-66be-41cb-8273-06b19f9a9ad4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.281165] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5708554b-66be-41cb-8273-06b19f9a9ad4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.406411] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 32ffe6c8-3c43-4477-ba28-405c32ea0087: rpc.has_security_group_logging(os_id): False [ 1071.427558] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.427558] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.427803] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.428070] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.428070] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.428282] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.428389] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.428453] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.428614] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.428735] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.428829] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32ffe6c8-3c43-4477-ba28-405c32ea0087 is going to be created. [ 1071.500606] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.501034] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.501034] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.501113] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.501306] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.518546] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 32ffe6c8-3c43-4477-ba28-405c32ea0087 in Status: IN_PROGRESS for 2s [ 1071.743554] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-29a28398-6e5b-4a4f-81e9-a2f458468c19 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.743740] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.743782] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.744078] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.744277] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.744386] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.744453] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.744646] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.744742] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.744835] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.744990] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-29a28398-6e5b-4a4f-81e9-a2f458468c19 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.745153] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.745256] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.745414] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.745561] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.745656] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.745718] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.745853] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.745931] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.746038] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.746139] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('29a28398-6e5b-4a4f-81e9-a2f458468c19',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.782495] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-074be4e0-ffc9-4ec9-b29a-40406844218c taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.782666] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.783123] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5708554b-66be-41cb-8273-06b19f9a9ad4 with status ACTIVE [ 1071.783123] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.783123] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.783283] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.783384] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.783473] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.783809] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.783809] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.783809] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.783991] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.784090] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.784302] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.784853] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.784853] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.784853] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.784853] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.784853] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5708554b-66be-41cb-8273-06b19f9a9ad4 is going to be updated. [ 1071.810495] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.810720] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.810835] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.811064] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.811204] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.811365] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5708554b-66be-41cb-8273-06b19f9a9ad4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.248762] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 29a28398-6e5b-4a4f-81e9-a2f458468c19: rpc.has_security_group_logging(os_id): False [ 1072.266431] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.266630] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.266630] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.266903] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.267015] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.267220] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.267322] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.267387] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.267535] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.267613] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.267816] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.267903] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.268010] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.268112] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.268185] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.268361] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.268451] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.268511] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.268643] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.268718] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.268802] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 is going to be updated. [ 1072.338661] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.338993] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.338993] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.339176] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.339224] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.353204] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 in Status: IN_PROGRESS for 2s [ 1073.065794] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 074be4e0-ffc9-4ec9-b29a-40406844218c in Status: SUCCESS [ 1073.066092] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.066272] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.066500] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.066696] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.066811] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.066881] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.067048] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.067136] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.067236] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.533528] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 32ffe6c8-3c43-4477-ba28-405c32ea0087 in Status: SUCCESS [ 1073.533983] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32ffe6c8-3c43-4477-ba28-405c32ea0087" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.569616] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.072914] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.152585] env[62842]: INFO networking_nsxv3.common.synchronization [req-642f0307-e18e-4243-942c-0fff6333cde4 req-41595eaa-ad19-4fc5-a7df-e2dfa5d906ef tempest-MultipleCreateTestJSON-1704086459 tempest-MultipleCreateTestJSON-1704086459-project-member] Enqueued Resource ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 with Priority: HIGHEST for action security_group_members [ 1074.153363] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 with Priority: HIGHEST for action security_group_members [ 1074.154137] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-29a28398-6e5b-4a4f-81e9-a2f458468c19 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.154241] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.154546] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.154644] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.154885] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.155052] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.156040] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.156040] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.156040] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.156040] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29a28398-6e5b-4a4f-81e9-a2f458468c19',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.371032] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 in Status: SUCCESS [ 1074.371032] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.575380] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.575562] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.575669] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.575803] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.575892] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.575988] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 074be4e0-ffc9-4ec9-b29a-40406844218c is going to be updated. [ 1074.606742] env[62842]: INFO networking_nsxv3.common.synchronization [req-ca4230d8-ab77-40af-afaf-ceb7c7e12ccb req-6a455772-863a-41c5-9805-fd43bafbb8f7 tempest-MultipleCreateTestJSON-1704086459 tempest-MultipleCreateTestJSON-1704086459-project-member] Enqueued Resource ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 with Priority: HIGHEST for action security_group_members [ 1074.607320] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 with Priority: HIGHEST for action security_group_members [ 1074.607627] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-29a28398-6e5b-4a4f-81e9-a2f458468c19 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.607734] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.612334] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.612489] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.612551] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.613210] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.613210] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.625850] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 074be4e0-ffc9-4ec9-b29a-40406844218c in Status: IN_PROGRESS for 2s [ 1074.659804] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('29a28398-6e5b-4a4f-81e9-a2f458468c19',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.161951] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('29a28398-6e5b-4a4f-81e9-a2f458468c19',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.664611] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.664865] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.664988] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.667025] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.667025] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.667025] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 is going to be updated. [ 1075.703294] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.703442] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.703877] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.703970] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.704163] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.715319] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 in Status: IN_PROGRESS for 2s [ 1076.634208] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 074be4e0-ffc9-4ec9-b29a-40406844218c in Status: SUCCESS [ 1076.634521] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.634592] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.634807] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.635040] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.635167] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.635252] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.635414] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.635508] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.635606] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.635696] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.137854] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-074be4e0-ffc9-4ec9-b29a-40406844218c taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.138124] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.138233] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.138559] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.138836] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.138993] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.139115] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.139367] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.139566] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.139814] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.140081] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-074be4e0-ffc9-4ec9-b29a-40406844218c taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.140233] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.140333] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.140577] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.140851] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.140960] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.141070] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.141295] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.141423] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.141555] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.141787] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.644397] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 074be4e0-ffc9-4ec9-b29a-40406844218c: rpc.has_security_group_logging(os_id): False [ 1077.667757] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.667757] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.667956] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.668059] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.668232] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.668719] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.668719] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.668719] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.668719] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.668980] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.668980] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.669084] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.669119] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.669516] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.669516] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.669516] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.669726] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.669726] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.669791] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.669829] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.669900] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 074be4e0-ffc9-4ec9-b29a-40406844218c is going to be updated. [ 1077.727221] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 in Status: SUCCESS [ 1077.727497] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.727681] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.727905] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.728113] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.728236] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.728301] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.728482] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.728606] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.728716] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29a28398-6e5b-4a4f-81e9-a2f458468c19',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.746121] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.746121] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.746121] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.746366] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.746490] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.761460] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 074be4e0-ffc9-4ec9-b29a-40406844218c in Status: IN_PROGRESS for 2s [ 1078.232044] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.232541] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.232541] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.232715] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.232802] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.233068] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.233215] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.233310] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.233521] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.233636] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.233795] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 is going to be updated. [ 1078.286323] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.286699] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.286817] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.287134] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.287342] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.297986] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 in Status: IN_PROGRESS for 2s [ 1079.608237] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1079.608536] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1079.654028] env[62842]: INFO networking_nsxv3.common.synchronization [req-2bc92982-c0cd-4dfd-902e-7e35f9a3ccba req-54767b76-8652-493d-ba30-c24c3c4e1e97 tempest-ServerDiskConfigTestJSON-797549774 tempest-ServerDiskConfigTestJSON-797549774-project-member] Enqueued Resource ID: c184a589-476a-49bd-9984-d339a77ec8f3 with Priority: HIGHEST for action security_group_members [ 1079.654596] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c184a589-476a-49bd-9984-d339a77ec8f3 with Priority: HIGHEST for action security_group_members [ 1079.654908] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-c184a589-476a-49bd-9984-d339a77ec8f3 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.655045] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.655113] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.655307] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.655461] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.655561] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.655623] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.655767] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.655853] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.656058] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c184a589-476a-49bd-9984-d339a77ec8f3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.776584] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 074be4e0-ffc9-4ec9-b29a-40406844218c in Status: SUCCESS [ 1079.776873] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.158392] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.158628] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.158628] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.158824] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.158916] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.159134] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.159248] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.159299] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.159483] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.159583] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.159694] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c184a589-476a-49bd-9984-d339a77ec8f3 is going to be updated. [ 1080.198425] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.198620] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.198620] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.198827] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.198964] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.208696] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c184a589-476a-49bd-9984-d339a77ec8f3 in Status: IN_PROGRESS for 2s [ 1080.308638] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 in Status: SUCCESS [ 1080.308859] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 deletion is rescheduled due to dependency. [ 1080.308984] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.924498] env[62842]: INFO networking_nsxv3.common.synchronization [req-4686d940-241b-4520-a5af-7650f994a179 req-f4bee59c-f378-4f2a-86e6-410fd8e7c705 tempest-ImagesTestJSON-1786483082 tempest-ImagesTestJSON-1786483082-project-member] Enqueued Resource ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 with Priority: HIGHEST for action security_group_members [ 1080.925063] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 with Priority: HIGHEST for action security_group_members [ 1080.925381] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e26630c-b3f7-4b48-9720-77b59135adf4 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.925502] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.925569] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.925758] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.925911] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.926022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.926208] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.926361] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.926452] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.926544] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e26630c-b3f7-4b48-9720-77b59135adf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.429061] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.429273] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.429336] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.429562] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.429691] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.430046] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.430046] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.430046] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.430263] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.430315] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.430358] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 is going to be updated. [ 1081.458541] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.459079] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.459163] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.459369] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.459510] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.471330] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 in Status: IN_PROGRESS for 2s [ 1082.223017] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c184a589-476a-49bd-9984-d339a77ec8f3 in Status: SUCCESS [ 1082.223506] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c184a589-476a-49bd-9984-d339a77ec8f3 deletion is rescheduled due to dependency. [ 1082.223506] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.481341] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 in Status: SUCCESS [ 1083.482051] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 deletion is rescheduled due to dependency. [ 1083.482051] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.379471] env[62842]: INFO networking_nsxv3.common.synchronization [req-1059caf2-8f28-4a21-ba26-63da0ce4f8db req-69d69109-7f14-4c88-ab1a-83691df46ef3 tempest-DeleteServersTestJSON-1113791748 tempest-DeleteServersTestJSON-1113791748-project-member] Enqueued Resource ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 with Priority: HIGHEST for action security_group_members [ 1084.380096] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 with Priority: HIGHEST for action security_group_members [ 1084.380427] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-35146777-fd28-4ac7-b454-f7dd3fbb5846 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.380556] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.380625] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.380949] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.381284] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.381398] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.381483] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.381651] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.381837] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.381996] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('35146777-fd28-4ac7-b454-f7dd3fbb5846',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.884770] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.885111] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.885111] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.885259] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.885352] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.885544] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.885646] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.885709] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.885854] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.885931] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.886031] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 is going to be updated. [ 1084.913210] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.914096] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.914096] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.914096] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.914096] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.923554] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 in Status: IN_PROGRESS for 2s [ 1086.934692] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 in Status: SUCCESS [ 1086.935067] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 deletion is rescheduled due to dependency. [ 1086.935067] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.381376] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1089.381635] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1091.115196] env[62842]: INFO networking_nsxv3.common.synchronization [req-29f377de-0588-4b41-9995-dfaf632b4a3d req-1fbb903e-5010-484a-94bf-977275673887 tempest-AttachInterfacesTestJSON-2140085841 tempest-AttachInterfacesTestJSON-2140085841-project-member] Enqueued Resource ID: 32ffe6c8-3c43-4477-ba28-405c32ea0087 with Priority: HIGHEST for action security_group_members [ 1091.116464] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32ffe6c8-3c43-4477-ba28-405c32ea0087 with Priority: HIGHEST for action security_group_members [ 1091.116867] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-32ffe6c8-3c43-4477-ba28-405c32ea0087 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.117030] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32ffe6c8-3c43-4477-ba28-405c32ea0087" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.117086] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32ffe6c8-3c43-4477-ba28-405c32ea0087" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.117295] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32ffe6c8-3c43-4477-ba28-405c32ea0087" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.117452] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.117552] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.117618] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.117766] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.117850] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.117950] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32ffe6c8-3c43-4477-ba28-405c32ea0087',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.583678] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-416 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.583897] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-416" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.584029] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-416" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.584707] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-416" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.584997] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.585191] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.585304] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.585527] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.585679] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.585891] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1091.586018] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1091.586142] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1091.586594] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1091.586594] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1091.586594] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1091.586883] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1091.608975] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1091.609129] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1091.609283] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1091.609468] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-416" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.609932] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-4d14a806-ff19-44f7-95dd-5be89df2520f taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.610040] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-4d14a806-ff19-44f7-95dd-5be89df2520f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.610128] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-4d14a806-ff19-44f7-95dd-5be89df2520f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.610594] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-4d14a806-ff19-44f7-95dd-5be89df2520f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.610594] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d14a806-ff19-44f7-95dd-5be89df2520f',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.619835] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('32ffe6c8-3c43-4477-ba28-405c32ea0087',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.115201] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.115201] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.115201] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.115643] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.115700] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.115865] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 4d14a806-ff19-44f7-95dd-5be89df2520f not found, creating... [ 1092.116269] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.116568] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.116723] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.116999] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.117173] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.117517] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.117747] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.117964] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.118340] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.118589] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.118843] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 4d14a806-ff19-44f7-95dd-5be89df2520f is going to be created. [ 1092.121961] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('32ffe6c8-3c43-4477-ba28-405c32ea0087',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.151966] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.152226] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.152358] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.152655] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.152911] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.153170] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-4d14a806-ff19-44f7-95dd-5be89df2520f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.626197] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.626290] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.626349] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.626564] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.626654] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.626758] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32ffe6c8-3c43-4477-ba28-405c32ea0087 is going to be updated. [ 1092.656192] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.656343] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.656414] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.656623] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.656767] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.669232] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32ffe6c8-3c43-4477-ba28-405c32ea0087 in Status: IN_PROGRESS for 2s [ 1093.122444] env[62842]: INFO networking_nsxv3.common.synchronization [None req-e4a9c591-6d90-4c6e-bc08-b4f372175999 None None] Enqueued Resource ID: 432b8328-d42d-4d4e-9869-faa3510ee675 with Priority: HIGHEST for action port [ 1093.123067] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 432b8328-d42d-4d4e-9869-faa3510ee675 with Priority: HIGHEST for action port [ 1093.123318] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-432b8328-d42d-4d4e-9869-faa3510ee675 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.123440] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-432b8328-d42d-4d4e-9869-faa3510ee675" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.123503] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-432b8328-d42d-4d4e-9869-faa3510ee675" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.123763] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-432b8328-d42d-4d4e-9869-faa3510ee675" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.124067] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('432b8328-d42d-4d4e-9869-faa3510ee675',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.464231] env[62842]: INFO networking_nsxv3.common.synchronization [req-29f377de-0588-4b41-9995-dfaf632b4a3d req-40b65b3a-cf8d-483c-8fa3-bbb6f28c784e service nova] Enqueued Resource ID: 32ffe6c8-3c43-4477-ba28-405c32ea0087 with Priority: HIGHEST for action security_group_rules [ 1093.464231] env[62842]: INFO networking_nsxv3.common.synchronization [req-29f377de-0588-4b41-9995-dfaf632b4a3d req-40b65b3a-cf8d-483c-8fa3-bbb6f28c784e service nova] Enqueued Resource ID: 32ffe6c8-3c43-4477-ba28-405c32ea0087 with Priority: HIGHEST for action security_group_members [ 1093.464231] env[62842]: INFO networking_nsxv3.common.synchronization [req-29f377de-0588-4b41-9995-dfaf632b4a3d req-40b65b3a-cf8d-483c-8fa3-bbb6f28c784e service nova] Enqueued Resource ID: 4d14a806-ff19-44f7-95dd-5be89df2520f with Priority: HIGHEST for action port [ 1093.464231] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32ffe6c8-3c43-4477-ba28-405c32ea0087 with Priority: HIGHEST for action security_group_rules [ 1093.464231] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32ffe6c8-3c43-4477-ba28-405c32ea0087 with Priority: HIGHEST for action security_group_members [ 1093.464231] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d14a806-ff19-44f7-95dd-5be89df2520f with Priority: HIGHEST for action port [ 1093.464231] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32ffe6c8-3c43-4477-ba28-405c32ea0087 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.464231] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32ffe6c8-3c43-4477-ba28-405c32ea0087" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.464231] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32ffe6c8-3c43-4477-ba28-405c32ea0087" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.464231] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32ffe6c8-3c43-4477-ba28-405c32ea0087" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.465661] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32ffe6c8-3c43-4477-ba28-405c32ea0087',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.467156] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-32ffe6c8-3c43-4477-ba28-405c32ea0087 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.467457] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32ffe6c8-3c43-4477-ba28-405c32ea0087" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.469333] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d14a806-ff19-44f7-95dd-5be89df2520f taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.469333] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d14a806-ff19-44f7-95dd-5be89df2520f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.469333] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d14a806-ff19-44f7-95dd-5be89df2520f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.469333] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d14a806-ff19-44f7-95dd-5be89df2520f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.469333] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d14a806-ff19-44f7-95dd-5be89df2520f',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.643120] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 432b8328-d42d-4d4e-9869-faa3510ee675 [ 1093.643804] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.643804] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.643804] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.643804] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.643804] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.644279] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:432b8328-d42d-4d4e-9869-faa3510ee675 already deleted. [ 1093.644279] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-432b8328-d42d-4d4e-9869-faa3510ee675" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.645839] env[62842]: INFO networking_nsxv3.common.synchronization [req-cd689c7f-1b12-4f2a-baac-b03f29258807 req-14a06f0b-1c98-4786-9f2e-f925f3b079f8 tempest-ServerDiskConfigTestJSON-797549774 tempest-ServerDiskConfigTestJSON-797549774-project-member] Enqueued Resource ID: c184a589-476a-49bd-9984-d339a77ec8f3 with Priority: HIGHEST for action security_group_members [ 1093.646181] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c184a589-476a-49bd-9984-d339a77ec8f3 with Priority: HIGHEST for action security_group_members [ 1093.646594] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-c184a589-476a-49bd-9984-d339a77ec8f3 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.646707] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.646769] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.646944] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.647096] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.647189] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.647249] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.647385] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.647464] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.647550] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c184a589-476a-49bd-9984-d339a77ec8f3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.974322] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4d14a806-ff19-44f7-95dd-5be89df2520f with status ACTIVE [ 1093.974322] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.974322] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.974322] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.974322] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.974322] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.974322] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.974322] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.974322] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.974322] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.974322] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.974322] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.974322] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.974322] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.974322] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.974322] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.974322] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4d14a806-ff19-44f7-95dd-5be89df2520f is going to be updated. [ 1093.975163] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-32ffe6c8-3c43-4477-ba28-405c32ea0087 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.975390] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32ffe6c8-3c43-4477-ba28-405c32ea0087" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.999937] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.999937] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.999937] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.999937] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.999937] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.999937] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d14a806-ff19-44f7-95dd-5be89df2520f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.019696] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-51 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.019944] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-51" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.020106] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-51" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.020383] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-51" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.020660] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.020824] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.020945] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.021366] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.021525] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.021760] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1094.021876] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1094.021992] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1094.022115] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1094.022230] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1094.022869] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1094.023092] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1094.044267] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1094.044462] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1094.044605] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1094.044786] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-51" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.045125] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-befb19dd-ec13-4333-8d1b-e211bb896199 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.045301] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-befb19dd-ec13-4333-8d1b-e211bb896199" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.045423] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-befb19dd-ec13-4333-8d1b-e211bb896199" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.045773] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-befb19dd-ec13-4333-8d1b-e211bb896199" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.045914] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('befb19dd-ec13-4333-8d1b-e211bb896199',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.152138] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.152138] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.152138] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.152138] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.152138] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.152138] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.152138] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.152138] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.152138] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.152138] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.152138] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c184a589-476a-49bd-9984-d339a77ec8f3 is going to be updated. [ 1094.184120] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.184474] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.184474] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.185360] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.185360] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.198431] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c184a589-476a-49bd-9984-d339a77ec8f3 in Status: IN_PROGRESS for 2s [ 1094.548175] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.548425] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.548578] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.549219] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.549219] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.549219] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port befb19dd-ec13-4333-8d1b-e211bb896199 not found, creating... [ 1094.549513] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.549573] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.549797] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.550106] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.550670] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.550670] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.550670] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.550819] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.550999] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.551177] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.551326] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: befb19dd-ec13-4333-8d1b-e211bb896199 is going to be created. [ 1094.575202] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.575923] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.576143] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.576566] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.576842] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.577150] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-befb19dd-ec13-4333-8d1b-e211bb896199" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.680205] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32ffe6c8-3c43-4477-ba28-405c32ea0087 in Status: SUCCESS [ 1094.680438] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32ffe6c8-3c43-4477-ba28-405c32ea0087" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.680602] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32ffe6c8-3c43-4477-ba28-405c32ea0087" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.680834] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32ffe6c8-3c43-4477-ba28-405c32ea0087" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.681054] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.681178] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.681243] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.681397] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.681483] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.681575] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32ffe6c8-3c43-4477-ba28-405c32ea0087',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.184454] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('32ffe6c8-3c43-4477-ba28-405c32ea0087',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.291256] env[62842]: INFO networking_nsxv3.common.synchronization [None req-0cfb86ba-7461-4bea-aaf3-a38922db95a9 None None] Enqueued Resource ID: 5a794f9c-39c6-4790-acd1-63b738d5dbcd with Priority: HIGHEST for action port [ 1095.296151] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a794f9c-39c6-4790-acd1-63b738d5dbcd with Priority: HIGHEST for action port [ 1095.296932] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-5a794f9c-39c6-4790-acd1-63b738d5dbcd taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.297168] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5a794f9c-39c6-4790-acd1-63b738d5dbcd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.297282] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5a794f9c-39c6-4790-acd1-63b738d5dbcd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.297668] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5a794f9c-39c6-4790-acd1-63b738d5dbcd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.298036] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a794f9c-39c6-4790-acd1-63b738d5dbcd',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.361310] env[62842]: INFO networking_nsxv3.common.synchronization [req-cd689c7f-1b12-4f2a-baac-b03f29258807 req-73a52ada-ef59-4583-95f1-b8d22f3ce43e service nova] Enqueued Resource ID: c184a589-476a-49bd-9984-d339a77ec8f3 with Priority: HIGHEST for action security_group_rules [ 1095.361489] env[62842]: INFO networking_nsxv3.common.synchronization [req-cd689c7f-1b12-4f2a-baac-b03f29258807 req-73a52ada-ef59-4583-95f1-b8d22f3ce43e service nova] Enqueued Resource ID: c184a589-476a-49bd-9984-d339a77ec8f3 with Priority: HIGHEST for action security_group_members [ 1095.361655] env[62842]: INFO networking_nsxv3.common.synchronization [req-cd689c7f-1b12-4f2a-baac-b03f29258807 req-73a52ada-ef59-4583-95f1-b8d22f3ce43e service nova] Enqueued Resource ID: befb19dd-ec13-4333-8d1b-e211bb896199 with Priority: HIGHEST for action port [ 1095.362010] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c184a589-476a-49bd-9984-d339a77ec8f3 with Priority: HIGHEST for action security_group_rules [ 1095.362294] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c184a589-476a-49bd-9984-d339a77ec8f3 with Priority: HIGHEST for action security_group_members [ 1095.362294] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: befb19dd-ec13-4333-8d1b-e211bb896199 with Priority: HIGHEST for action port [ 1095.363117] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c184a589-476a-49bd-9984-d339a77ec8f3 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.363246] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.363312] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.363876] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.363876] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c184a589-476a-49bd-9984-d339a77ec8f3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.364439] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-c184a589-476a-49bd-9984-d339a77ec8f3 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.364531] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.364901] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-befb19dd-ec13-4333-8d1b-e211bb896199 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.365034] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-befb19dd-ec13-4333-8d1b-e211bb896199" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.365097] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-befb19dd-ec13-4333-8d1b-e211bb896199" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.365255] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-befb19dd-ec13-4333-8d1b-e211bb896199" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.365327] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('befb19dd-ec13-4333-8d1b-e211bb896199',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.686530] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('32ffe6c8-3c43-4477-ba28-405c32ea0087',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.801048] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5a794f9c-39c6-4790-acd1-63b738d5dbcd [ 1095.801364] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.801501] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.801570] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.801804] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.801899] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.801994] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5a794f9c-39c6-4790-acd1-63b738d5dbcd already deleted. [ 1095.802090] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5a794f9c-39c6-4790-acd1-63b738d5dbcd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.867631] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-c184a589-476a-49bd-9984-d339a77ec8f3 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.867756] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.868162] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port befb19dd-ec13-4333-8d1b-e211bb896199 with status ACTIVE [ 1095.868162] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.868317] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.868317] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.868558] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.868658] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.868832] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.868918] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.868918] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.869118] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.869179] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.869344] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.869474] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.869474] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.869619] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.869697] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.869810] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: befb19dd-ec13-4333-8d1b-e211bb896199 is going to be updated. [ 1095.893594] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.893728] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.893804] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.894014] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.894147] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.894303] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-befb19dd-ec13-4333-8d1b-e211bb896199" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.036153] env[62842]: INFO networking_nsxv3.common.synchronization [req-46429631-c42c-4c7c-bbe5-13fa461894a2 req-ae904bab-d0d0-4f1f-985d-eb3cf6e2c1f1 tempest-ImagesTestJSON-1786483082 tempest-ImagesTestJSON-1786483082-project-member] Enqueued Resource ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 with Priority: HIGHEST for action security_group_members [ 1096.036153] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 with Priority: HIGHEST for action security_group_members [ 1096.036153] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e26630c-b3f7-4b48-9720-77b59135adf4 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.036153] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.036153] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.037166] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.037497] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.037756] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.038053] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.038367] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.038575] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.038880] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e26630c-b3f7-4b48-9720-77b59135adf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.190604] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.190986] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.190986] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.191121] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.191211] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.191317] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32ffe6c8-3c43-4477-ba28-405c32ea0087 is going to be updated. [ 1096.206028] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c184a589-476a-49bd-9984-d339a77ec8f3 in Status: SUCCESS [ 1096.206432] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c184a589-476a-49bd-9984-d339a77ec8f3 deletion is rescheduled due to dependency. [ 1096.206432] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.206939] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.206939] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.206939] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.206939] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.207165] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.207165] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.207260] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.207307] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c184a589-476a-49bd-9984-d339a77ec8f3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.221260] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.221441] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.221493] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.221653] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.221853] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.232036] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32ffe6c8-3c43-4477-ba28-405c32ea0087 in Status: IN_PROGRESS for 2s [ 1096.375545] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-41 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.375545] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-41" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.375545] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-41" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.375545] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-41" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.375545] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.375545] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.375545] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.375545] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.375545] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.375545] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1096.375545] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1096.375545] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1096.375545] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1096.376573] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1096.376573] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1096.376573] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1096.400553] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1096.401798] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1096.401798] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1096.401798] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-41" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.402133] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-6baa67fe-1bc9-4390-afad-7ea33b14dddd taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.402261] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-6baa67fe-1bc9-4390-afad-7ea33b14dddd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.402460] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-6baa67fe-1bc9-4390-afad-7ea33b14dddd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.402950] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-6baa67fe-1bc9-4390-afad-7ea33b14dddd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.404128] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6baa67fe-1bc9-4390-afad-7ea33b14dddd',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.542197] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.542349] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.542446] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.542658] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.542806] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.543037] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.543139] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.543203] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.543353] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.543431] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.543520] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 is going to be updated. [ 1096.567291] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.567463] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.567506] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.567668] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.567808] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.576417] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 in Status: IN_PROGRESS for 2s [ 1096.711013] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c184a589-476a-49bd-9984-d339a77ec8f3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.906343] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.906588] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.906714] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.906983] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.907156] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.907318] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 6baa67fe-1bc9-4390-afad-7ea33b14dddd not found, creating... [ 1096.907575] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.907734] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.907856] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.908092] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.908237] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.908524] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.908683] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.908803] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.909027] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.909170] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.909310] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 6baa67fe-1bc9-4390-afad-7ea33b14dddd is going to be created. [ 1096.929716] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.929957] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.930089] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.930365] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.930595] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.930889] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-6baa67fe-1bc9-4390-afad-7ea33b14dddd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.213325] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c184a589-476a-49bd-9984-d339a77ec8f3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.715966] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.716269] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.716346] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.716580] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.716674] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.716773] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c184a589-476a-49bd-9984-d339a77ec8f3 is going to be updated. [ 1097.744103] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.744291] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.744360] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.744574] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.744722] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.753810] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c184a589-476a-49bd-9984-d339a77ec8f3 in Status: IN_PROGRESS for 2s [ 1097.958422] env[62842]: INFO networking_nsxv3.common.synchronization [req-46429631-c42c-4c7c-bbe5-13fa461894a2 req-6a21433b-03ec-4ccf-b040-7bea59639975 service nova] Enqueued Resource ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 with Priority: HIGHEST for action security_group_rules [ 1097.958615] env[62842]: INFO networking_nsxv3.common.synchronization [req-46429631-c42c-4c7c-bbe5-13fa461894a2 req-6a21433b-03ec-4ccf-b040-7bea59639975 service nova] Enqueued Resource ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 with Priority: HIGHEST for action security_group_members [ 1097.958755] env[62842]: INFO networking_nsxv3.common.synchronization [req-46429631-c42c-4c7c-bbe5-13fa461894a2 req-6a21433b-03ec-4ccf-b040-7bea59639975 service nova] Enqueued Resource ID: 6baa67fe-1bc9-4390-afad-7ea33b14dddd with Priority: HIGHEST for action port [ 1097.958993] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 with Priority: HIGHEST for action security_group_rules [ 1097.959140] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 with Priority: HIGHEST for action security_group_members [ 1097.959237] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6baa67fe-1bc9-4390-afad-7ea33b14dddd with Priority: HIGHEST for action port [ 1097.959838] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e26630c-b3f7-4b48-9720-77b59135adf4 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.959913] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.959984] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.960206] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.960310] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e26630c-b3f7-4b48-9720-77b59135adf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.961169] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e26630c-b3f7-4b48-9720-77b59135adf4 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.961268] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.961461] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-6baa67fe-1bc9-4390-afad-7ea33b14dddd taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.961561] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6baa67fe-1bc9-4390-afad-7ea33b14dddd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.961624] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6baa67fe-1bc9-4390-afad-7ea33b14dddd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.961817] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6baa67fe-1bc9-4390-afad-7ea33b14dddd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.961950] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6baa67fe-1bc9-4390-afad-7ea33b14dddd',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.242048] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32ffe6c8-3c43-4477-ba28-405c32ea0087 in Status: SUCCESS [ 1098.242357] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32ffe6c8-3c43-4477-ba28-405c32ea0087" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.242423] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32ffe6c8-3c43-4477-ba28-405c32ea0087" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.242628] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32ffe6c8-3c43-4477-ba28-405c32ea0087" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.242840] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.243038] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.243127] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.243295] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.243395] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.243461] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32ffe6c8-3c43-4477-ba28-405c32ea0087" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.243553] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('32ffe6c8-3c43-4477-ba28-405c32ea0087',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.465823] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6baa67fe-1bc9-4390-afad-7ea33b14dddd with status ACTIVE [ 1098.466222] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.466439] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.466554] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.466886] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.467105] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.467346] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.467510] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.467620] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.467833] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.467923] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.468146] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.468248] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.468313] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.468457] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.468535] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.468624] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6baa67fe-1bc9-4390-afad-7ea33b14dddd is going to be updated. [ 1098.469965] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e26630c-b3f7-4b48-9720-77b59135adf4 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.470564] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.494208] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.494411] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.494462] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.494644] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.494781] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.494942] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6baa67fe-1bc9-4390-afad-7ea33b14dddd" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.585920] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 in Status: SUCCESS [ 1098.586148] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 deletion is rescheduled due to dependency. [ 1098.586269] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.586427] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.586654] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.586832] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.586949] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.587022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.587168] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.587246] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.587341] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e26630c-b3f7-4b48-9720-77b59135adf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.745477] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('32ffe6c8-3c43-4477-ba28-405c32ea0087',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.089828] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e26630c-b3f7-4b48-9720-77b59135adf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.247870] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 32ffe6c8-3c43-4477-ba28-405c32ea0087: rpc.has_security_group_logging(os_id): False [ 1099.289303] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.289303] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.289303] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.289527] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.289527] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.289712] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.289886] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.289949] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.290118] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.290210] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.290303] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32ffe6c8-3c43-4477-ba28-405c32ea0087 is going to be updated. [ 1099.407347] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.407590] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.407590] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.407859] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.407984] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.423690] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 32ffe6c8-3c43-4477-ba28-405c32ea0087 in Status: IN_PROGRESS for 2s [ 1099.593513] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e26630c-b3f7-4b48-9720-77b59135adf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.765189] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c184a589-476a-49bd-9984-d339a77ec8f3 in Status: SUCCESS [ 1099.765473] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.765646] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.765977] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.766267] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.766499] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.766499] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.766715] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.766817] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.766896] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.767088] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c184a589-476a-49bd-9984-d339a77ec8f3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.099420] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.099420] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.099420] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.099420] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.099420] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.099420] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 is going to be updated. [ 1100.135789] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.135789] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.135789] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.135789] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.136038] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.147227] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 in Status: IN_PROGRESS for 2s [ 1100.256600] env[62842]: INFO networking_nsxv3.common.synchronization [req-2c2cc63d-4441-494a-af51-c5e8eef80ebf req-5dccc22f-2a1b-4bc4-a351-f6a80388c599 tempest-AttachVolumeTestJSON-43280943 tempest-AttachVolumeTestJSON-43280943-project-member] Enqueued Resource ID: 518e027d-4d1d-4cf5-a557-35f3eb956cd6 with Priority: HIGHEST for action security_group_members [ 1100.259030] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 518e027d-4d1d-4cf5-a557-35f3eb956cd6 with Priority: HIGHEST for action security_group_members [ 1100.259030] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-518e027d-4d1d-4cf5-a557-35f3eb956cd6 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.259030] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-518e027d-4d1d-4cf5-a557-35f3eb956cd6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.259030] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-518e027d-4d1d-4cf5-a557-35f3eb956cd6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.259030] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-518e027d-4d1d-4cf5-a557-35f3eb956cd6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.259030] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.259030] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.259030] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.259030] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.259030] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.259030] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('518e027d-4d1d-4cf5-a557-35f3eb956cd6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.269323] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-c184a589-476a-49bd-9984-d339a77ec8f3 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.269481] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.269553] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.269779] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.270404] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.270565] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.270623] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.270768] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.270853] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.270945] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.271117] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-c184a589-476a-49bd-9984-d339a77ec8f3 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.271214] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.271297] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.271793] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.271793] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.271793] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.271793] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.271992] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.271992] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.271992] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.272260] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c184a589-476a-49bd-9984-d339a77ec8f3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.650409] env[62842]: INFO networking_nsxv3.common.synchronization [req-f31f0327-2727-4430-95ce-31ddced3204a req-9f0acc30-7b89-4138-b709-f9f448720641 tempest-ServersTestJSON-1267616671 tempest-ServersTestJSON-1267616671-project-member] Enqueued Resource ID: 074be4e0-ffc9-4ec9-b29a-40406844218c with Priority: HIGHEST for action security_group_members [ 1100.651953] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 074be4e0-ffc9-4ec9-b29a-40406844218c with Priority: HIGHEST for action security_group_members [ 1100.653214] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-074be4e0-ffc9-4ec9-b29a-40406844218c taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.653450] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.653450] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.653613] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.653763] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.653862] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.653920] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.654129] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.654219] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.654266] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.761164] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.761382] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.761382] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.761601] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.762041] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.762278] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.762378] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.762434] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.762612] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.762683] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.762769] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 518e027d-4d1d-4cf5-a557-35f3eb956cd6 is going to be updated. [ 1100.775942] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c184a589-476a-49bd-9984-d339a77ec8f3: rpc.has_security_group_logging(os_id): False [ 1100.802156] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.802311] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.802311] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.802546] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.802637] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.802863] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.802978] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.803052] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.803203] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.803278] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.803487] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.803577] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.803636] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.803852] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.803926] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.805064] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.805216] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.805486] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.805689] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.805807] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.805930] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c184a589-476a-49bd-9984-d339a77ec8f3 is going to be updated. [ 1100.808217] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.808359] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.808468] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.808657] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.810490] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.820286] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 518e027d-4d1d-4cf5-a557-35f3eb956cd6 in Status: IN_PROGRESS for 2s [ 1100.891485] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.891648] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.891703] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.891962] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.892209] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.906185] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c184a589-476a-49bd-9984-d339a77ec8f3 in Status: IN_PROGRESS for 2s [ 1101.050578] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-509 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.050760] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-509" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.050760] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-509" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.051032] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-509" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.051348] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.051514] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.051636] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.051912] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.052102] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.052350] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1101.052462] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1101.052582] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1101.052710] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1101.052885] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1101.053082] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1101.053280] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1101.077666] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1101.077860] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1101.078054] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1101.078258] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-509" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.078591] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-c0eac070-ae8e-4691-9183-c54e21856ee1 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.078771] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-c0eac070-ae8e-4691-9183-c54e21856ee1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.078897] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-c0eac070-ae8e-4691-9183-c54e21856ee1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.079274] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-c0eac070-ae8e-4691-9183-c54e21856ee1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.079453] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0eac070-ae8e-4691-9183-c54e21856ee1',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.156984] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.438121] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 32ffe6c8-3c43-4477-ba28-405c32ea0087 in Status: SUCCESS [ 1101.438407] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32ffe6c8-3c43-4477-ba28-405c32ea0087" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.582561] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.582788] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.582936] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.583302] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.583468] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.583631] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port c0eac070-ae8e-4691-9183-c54e21856ee1 not found, creating... [ 1101.583913] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.584134] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.584260] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.584491] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.584631] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.584926] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.585102] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.585221] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.585429] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.585566] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.585707] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: c0eac070-ae8e-4691-9183-c54e21856ee1 is going to be created. [ 1101.605123] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.605410] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.605493] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.605770] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.606014] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.606252] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-c0eac070-ae8e-4691-9183-c54e21856ee1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.660112] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.160280] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 in Status: SUCCESS [ 1102.160501] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.160668] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.160892] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.161098] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.161216] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.161280] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.161427] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.161567] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.161617] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.161673] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3e26630c-b3f7-4b48-9720-77b59135adf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.163040] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.163155] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.163223] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.163376] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.163453] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.163545] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 074be4e0-ffc9-4ec9-b29a-40406844218c is going to be updated. [ 1102.190361] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.190579] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.190579] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.190766] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.190902] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.201296] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 074be4e0-ffc9-4ec9-b29a-40406844218c in Status: IN_PROGRESS for 2s [ 1102.349370] env[62842]: INFO networking_nsxv3.common.synchronization [req-f31f0327-2727-4430-95ce-31ddced3204a req-4c6feb67-5fd8-4626-b4c3-0213dce9a312 service nova] Enqueued Resource ID: 074be4e0-ffc9-4ec9-b29a-40406844218c with Priority: HIGHEST for action security_group_rules [ 1102.349539] env[62842]: INFO networking_nsxv3.common.synchronization [req-f31f0327-2727-4430-95ce-31ddced3204a req-4c6feb67-5fd8-4626-b4c3-0213dce9a312 service nova] Enqueued Resource ID: 074be4e0-ffc9-4ec9-b29a-40406844218c with Priority: HIGHEST for action security_group_members [ 1102.349681] env[62842]: INFO networking_nsxv3.common.synchronization [req-f31f0327-2727-4430-95ce-31ddced3204a req-4c6feb67-5fd8-4626-b4c3-0213dce9a312 service nova] Enqueued Resource ID: c0eac070-ae8e-4691-9183-c54e21856ee1 with Priority: HIGHEST for action port [ 1102.350014] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 074be4e0-ffc9-4ec9-b29a-40406844218c with Priority: HIGHEST for action security_group_rules [ 1102.350147] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 074be4e0-ffc9-4ec9-b29a-40406844218c with Priority: HIGHEST for action security_group_members [ 1102.350310] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0eac070-ae8e-4691-9183-c54e21856ee1 with Priority: HIGHEST for action port [ 1102.350794] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-074be4e0-ffc9-4ec9-b29a-40406844218c taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.350938] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.350969] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.351176] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.351252] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.352150] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-074be4e0-ffc9-4ec9-b29a-40406844218c taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.352242] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.352409] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-c0eac070-ae8e-4691-9183-c54e21856ee1 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.352481] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c0eac070-ae8e-4691-9183-c54e21856ee1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.352542] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c0eac070-ae8e-4691-9183-c54e21856ee1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.352697] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c0eac070-ae8e-4691-9183-c54e21856ee1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.352792] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0eac070-ae8e-4691-9183-c54e21856ee1',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.665773] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e26630c-b3f7-4b48-9720-77b59135adf4 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.665773] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.665773] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.666223] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.666223] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.666315] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.666428] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.666504] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.667213] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.667213] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.667213] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e26630c-b3f7-4b48-9720-77b59135adf4 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.667213] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.667213] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.667617] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.667617] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.667617] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.667770] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.668167] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.668167] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.668167] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.668617] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3e26630c-b3f7-4b48-9720-77b59135adf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.833628] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 518e027d-4d1d-4cf5-a557-35f3eb956cd6 in Status: SUCCESS [ 1102.834252] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 518e027d-4d1d-4cf5-a557-35f3eb956cd6 deletion is rescheduled due to dependency. [ 1102.834384] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-518e027d-4d1d-4cf5-a557-35f3eb956cd6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.856039] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-074be4e0-ffc9-4ec9-b29a-40406844218c taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.856233] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.856486] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c0eac070-ae8e-4691-9183-c54e21856ee1 with status ACTIVE [ 1102.857078] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.857263] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.857371] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.857635] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.857754] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.857958] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.858113] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.858194] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.858392] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.858494] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.858728] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.858841] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.858949] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.859529] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.859529] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.859529] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c0eac070-ae8e-4691-9183-c54e21856ee1 is going to be updated. [ 1102.869330] env[62842]: INFO networking_nsxv3.common.synchronization [None req-a1032aa1-2e2f-4493-87f1-3e36a2082bc2 tempest-AttachInterfacesTestJSON-2140085841 tempest-AttachInterfacesTestJSON-2140085841-project-member] Enqueued Resource ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 with Priority: HIGHEST for action security_group_members [ 1102.870146] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 with Priority: HIGHEST for action security_group_members [ 1102.870749] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.870884] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.870988] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.872944] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.872944] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.872944] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.872944] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.872944] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.873162] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.873270] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77637a7d-8eb8-4f0e-a5bd-9870e0d191c6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.885630] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.885782] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.885892] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.886078] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.886217] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.886404] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c0eac070-ae8e-4691-9183-c54e21856ee1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.923539] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c184a589-476a-49bd-9984-d339a77ec8f3 in Status: SUCCESS [ 1102.923974] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.171994] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3e26630c-b3f7-4b48-9720-77b59135adf4: rpc.has_security_group_logging(os_id): False [ 1103.191622] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.191773] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.191862] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.192095] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.192254] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.192405] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.192530] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.192560] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.192695] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.192779] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.192976] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.193138] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.193212] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.193356] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.193431] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.193610] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.193698] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.193811] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.193899] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.193963] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.194074] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 is going to be updated. [ 1103.260131] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.260287] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.260357] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.260611] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.260762] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.282839] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 in Status: IN_PROGRESS for 2s [ 1103.375630] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.375863] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.375930] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.376195] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.376327] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.376549] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.376686] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.376769] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.376967] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.377083] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.377174] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 is going to be updated. [ 1103.409304] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.409476] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.409578] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.409875] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.410063] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.422174] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 in Status: IN_PROGRESS for 2s [ 1104.211724] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 074be4e0-ffc9-4ec9-b29a-40406844218c in Status: SUCCESS [ 1104.212050] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.212187] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.212534] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.212534] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.212746] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.212746] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.212864] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.212963] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.213234] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.715405] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.217356] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.297087] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 in Status: SUCCESS [ 1105.297087] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.432940] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 in Status: SUCCESS [ 1105.432940] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 deletion is rescheduled due to dependency. [ 1105.432940] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.719433] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.719619] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.719684] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.720010] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.720118] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.720214] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 074be4e0-ffc9-4ec9-b29a-40406844218c is going to be updated. [ 1105.753072] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.753431] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.753431] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.753625] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.753728] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.766499] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 074be4e0-ffc9-4ec9-b29a-40406844218c in Status: IN_PROGRESS for 2s [ 1105.796743] env[62842]: INFO networking_nsxv3.common.synchronization [req-df632d32-6920-4f54-a19d-81e5972cb58d req-06d528bc-a032-42dc-83ce-8846aa83a80b tempest-ServerMetadataTestJSON-1251833882 tempest-ServerMetadataTestJSON-1251833882-project-member] Enqueued Resource ID: 0d049bd9-2d2b-49fc-98b0-e67bd0e7171b with Priority: HIGHEST for action security_group_members [ 1105.797383] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d049bd9-2d2b-49fc-98b0-e67bd0e7171b with Priority: HIGHEST for action security_group_members [ 1105.797682] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d049bd9-2d2b-49fc-98b0-e67bd0e7171b taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.797800] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d049bd9-2d2b-49fc-98b0-e67bd0e7171b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.797874] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d049bd9-2d2b-49fc-98b0-e67bd0e7171b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.798154] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d049bd9-2d2b-49fc-98b0-e67bd0e7171b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.798308] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.798405] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.798467] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.798650] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.798736] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.798827] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d049bd9-2d2b-49fc-98b0-e67bd0e7171b',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.301669] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.301669] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.301669] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.301669] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.301669] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.301669] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.302210] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.302210] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.302210] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.302210] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.302210] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d049bd9-2d2b-49fc-98b0-e67bd0e7171b already deleted. [ 1106.302210] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d049bd9-2d2b-49fc-98b0-e67bd0e7171b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.515360] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-961 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.515360] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-961" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.515360] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-961" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.517325] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-961" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.517720] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.517974] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.518151] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.518435] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.518619] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.518889] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1106.519064] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1106.519224] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1106.519381] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1106.520559] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1106.520559] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1106.520559] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1106.547954] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1106.548192] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1106.548302] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1106.548464] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-961" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.548791] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-1a67362a-5895-4a41-b0c5-e5ea68a7f306 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.548967] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-1a67362a-5895-4a41-b0c5-e5ea68a7f306" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.549105] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-1a67362a-5895-4a41-b0c5-e5ea68a7f306" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.549514] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-1a67362a-5895-4a41-b0c5-e5ea68a7f306" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.549611] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a67362a-5895-4a41-b0c5-e5ea68a7f306',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.053432] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.053731] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.053872] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.054300] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.054473] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.054639] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 1a67362a-5895-4a41-b0c5-e5ea68a7f306 not found, creating... [ 1107.054904] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.056292] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.056292] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.056292] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.056292] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.056292] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.056292] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.056292] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.056720] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.056720] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.056720] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 1a67362a-5895-4a41-b0c5-e5ea68a7f306 is going to be created. [ 1107.079053] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.079576] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.079576] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.079765] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.080135] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.080290] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-1a67362a-5895-4a41-b0c5-e5ea68a7f306" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.395436] env[62842]: INFO networking_nsxv3.common.synchronization [req-1140f2b1-44ab-4211-875c-5a32ac778de4 req-ecc176ff-1dd0-4627-ab4f-142e9ef0e551 tempest-ServerDiskConfigTestJSON-797549774 tempest-ServerDiskConfigTestJSON-797549774-project-member] Enqueued Resource ID: c184a589-476a-49bd-9984-d339a77ec8f3 with Priority: HIGHEST for action security_group_members [ 1107.396084] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c184a589-476a-49bd-9984-d339a77ec8f3 with Priority: HIGHEST for action security_group_members [ 1107.396384] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-c184a589-476a-49bd-9984-d339a77ec8f3 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.396539] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.396607] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.396874] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.397086] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.397227] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.397294] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.397456] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.397543] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.397648] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c184a589-476a-49bd-9984-d339a77ec8f3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.779047] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 074be4e0-ffc9-4ec9-b29a-40406844218c in Status: SUCCESS [ 1107.779047] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.779047] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.779047] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.779047] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.779047] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.779047] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.779047] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.779047] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.779047] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.779047] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.903099] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.903099] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.903099] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.903099] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.903099] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.903099] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.903099] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.903099] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.903099] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.903099] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.903099] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c184a589-476a-49bd-9984-d339a77ec8f3 is going to be updated. [ 1107.934129] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.934129] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.934129] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.934129] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.934129] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.942876] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c184a589-476a-49bd-9984-d339a77ec8f3 in Status: IN_PROGRESS for 2s [ 1108.007202] env[62842]: INFO networking_nsxv3.common.synchronization [req-df632d32-6920-4f54-a19d-81e5972cb58d req-13a7ee30-915c-49b1-85cc-cbad24fc26fc service nova] Enqueued Resource ID: 0d049bd9-2d2b-49fc-98b0-e67bd0e7171b with Priority: HIGHEST for action security_group_rules [ 1108.007202] env[62842]: INFO networking_nsxv3.common.synchronization [req-df632d32-6920-4f54-a19d-81e5972cb58d req-13a7ee30-915c-49b1-85cc-cbad24fc26fc service nova] Enqueued Resource ID: 0d049bd9-2d2b-49fc-98b0-e67bd0e7171b with Priority: HIGHEST for action security_group_members [ 1108.007202] env[62842]: INFO networking_nsxv3.common.synchronization [req-df632d32-6920-4f54-a19d-81e5972cb58d req-13a7ee30-915c-49b1-85cc-cbad24fc26fc service nova] Enqueued Resource ID: 1a67362a-5895-4a41-b0c5-e5ea68a7f306 with Priority: HIGHEST for action port [ 1108.007202] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d049bd9-2d2b-49fc-98b0-e67bd0e7171b with Priority: HIGHEST for action security_group_rules [ 1108.007202] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d049bd9-2d2b-49fc-98b0-e67bd0e7171b with Priority: HIGHEST for action security_group_members [ 1108.007202] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a67362a-5895-4a41-b0c5-e5ea68a7f306 with Priority: HIGHEST for action port [ 1108.007202] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0d049bd9-2d2b-49fc-98b0-e67bd0e7171b taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.009466] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0d049bd9-2d2b-49fc-98b0-e67bd0e7171b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.009684] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0d049bd9-2d2b-49fc-98b0-e67bd0e7171b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.010066] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0d049bd9-2d2b-49fc-98b0-e67bd0e7171b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.012111] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0d049bd9-2d2b-49fc-98b0-e67bd0e7171b',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.012344] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d049bd9-2d2b-49fc-98b0-e67bd0e7171b taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.012563] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d049bd9-2d2b-49fc-98b0-e67bd0e7171b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.012757] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d049bd9-2d2b-49fc-98b0-e67bd0e7171b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.014088] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d049bd9-2d2b-49fc-98b0-e67bd0e7171b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.014088] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.014088] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.014088] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.014088] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.014088] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.016828] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d049bd9-2d2b-49fc-98b0-e67bd0e7171b',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.019418] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a67362a-5895-4a41-b0c5-e5ea68a7f306 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.019418] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a67362a-5895-4a41-b0c5-e5ea68a7f306" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.019418] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a67362a-5895-4a41-b0c5-e5ea68a7f306" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.019418] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a67362a-5895-4a41-b0c5-e5ea68a7f306" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.019418] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a67362a-5895-4a41-b0c5-e5ea68a7f306',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.283245] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-074be4e0-ffc9-4ec9-b29a-40406844218c taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.283485] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.283588] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.283828] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.284187] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.284187] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.284361] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.286072] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.286252] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.286548] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.287382] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-074be4e0-ffc9-4ec9-b29a-40406844218c taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.287382] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.287382] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.287382] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.287653] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.287653] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.287769] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.287958] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.287958] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.288220] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.288220] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.520034] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d049bd9-2d2b-49fc-98b0-e67bd0e7171b taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.520349] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d049bd9-2d2b-49fc-98b0-e67bd0e7171b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.520920] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0d049bd9-2d2b-49fc-98b0-e67bd0e7171b',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.522894] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1a67362a-5895-4a41-b0c5-e5ea68a7f306 with status ACTIVE [ 1108.522894] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.523031] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.523031] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.523197] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.523289] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.523466] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.523549] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.523704] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.523775] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.523825] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.524880] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.524880] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.524880] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.524880] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.524880] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.524880] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1a67362a-5895-4a41-b0c5-e5ea68a7f306 is going to be updated. [ 1108.553021] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.553021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.553021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.553021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.553372] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.553915] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a67362a-5895-4a41-b0c5-e5ea68a7f306" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.791105] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 074be4e0-ffc9-4ec9-b29a-40406844218c: rpc.has_security_group_logging(os_id): False [ 1108.810598] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.810776] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.810825] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.811336] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.811336] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.811490] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.811490] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.811573] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.811712] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.811840] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.812148] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.812269] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.812344] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.812559] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.812686] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.812906] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.813027] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.813102] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.813268] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.813347] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.813444] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 074be4e0-ffc9-4ec9-b29a-40406844218c is going to be updated. [ 1108.884410] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.884611] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.884611] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.884828] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.884971] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.902135] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 074be4e0-ffc9-4ec9-b29a-40406844218c in Status: IN_PROGRESS for 2s [ 1109.024902] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0d049bd9-2d2b-49fc-98b0-e67bd0e7171b',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.492035] env[62842]: INFO networking_nsxv3.common.synchronization [None req-2f99c08a-d1c7-40dc-b782-5b8a86feadfd None None] Enqueued Resource ID: cdd20116-cce7-4f0b-9315-edf4d3caef8e with Priority: HIGHEST for action port [ 1109.492035] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdd20116-cce7-4f0b-9315-edf4d3caef8e with Priority: HIGHEST for action port [ 1109.492381] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-cdd20116-cce7-4f0b-9315-edf4d3caef8e taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.492513] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cdd20116-cce7-4f0b-9315-edf4d3caef8e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.492593] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cdd20116-cce7-4f0b-9315-edf4d3caef8e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.493081] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cdd20116-cce7-4f0b-9315-edf4d3caef8e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.493081] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cdd20116-cce7-4f0b-9315-edf4d3caef8e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.526954] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.527193] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.527193] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.527374] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.531917] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.531917] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d049bd9-2d2b-49fc-98b0-e67bd0e7171b is going to be created. [ 1109.557207] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.557353] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.557416] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.557664] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.557835] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.568997] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d049bd9-2d2b-49fc-98b0-e67bd0e7171b in Status: UNINITIALIZED for 2s [ 1109.957593] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c184a589-476a-49bd-9984-d339a77ec8f3 in Status: SUCCESS [ 1109.957851] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c184a589-476a-49bd-9984-d339a77ec8f3 deletion is rescheduled due to dependency. [ 1109.958010] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.996510] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cdd20116-cce7-4f0b-9315-edf4d3caef8e [ 1109.996838] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.996993] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.997124] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.997371] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.997508] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.997645] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cdd20116-cce7-4f0b-9315-edf4d3caef8e already deleted. [ 1109.997752] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cdd20116-cce7-4f0b-9315-edf4d3caef8e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.588680] env[62842]: INFO networking_nsxv3.common.synchronization [None req-02b516ae-1c66-4059-952b-0c9b0cd6f657 tempest-ServerActionsV293TestJSON-861524001 tempest-ServerActionsV293TestJSON-861524001-project-member] Enqueued Resource ID: 1738c05b-4a1d-4a1c-8845-0b28fe6c81bb with Priority: HIGHEST for action security_group_rules [ 1110.589220] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1738c05b-4a1d-4a1c-8845-0b28fe6c81bb with Priority: HIGHEST for action security_group_rules [ 1110.592766] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1738c05b-4a1d-4a1c-8845-0b28fe6c81bb taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.592766] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1738c05b-4a1d-4a1c-8845-0b28fe6c81bb" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.592766] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1738c05b-4a1d-4a1c-8845-0b28fe6c81bb" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.592766] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1738c05b-4a1d-4a1c-8845-0b28fe6c81bb" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.592766] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1738c05b-4a1d-4a1c-8845-0b28fe6c81bb',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.730993] env[62842]: INFO networking_nsxv3.common.synchronization [None req-1c851bb7-672b-4ab5-8007-9b9ff13801a9 tempest-ServerActionsV293TestJSON-861524001 tempest-ServerActionsV293TestJSON-861524001-project-member] Enqueued Resource ID: 1738c05b-4a1d-4a1c-8845-0b28fe6c81bb with Priority: HIGHEST for action security_group_rules [ 1110.731667] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1738c05b-4a1d-4a1c-8845-0b28fe6c81bb with Priority: HIGHEST for action security_group_rules [ 1110.732036] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1738c05b-4a1d-4a1c-8845-0b28fe6c81bb taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.732159] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1738c05b-4a1d-4a1c-8845-0b28fe6c81bb" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.914843] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 074be4e0-ffc9-4ec9-b29a-40406844218c in Status: SUCCESS [ 1110.915103] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.121856] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.121856] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.121856] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.121856] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.121856] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.121856] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1738c05b-4a1d-4a1c-8845-0b28fe6c81bb already deleted. [ 1111.121856] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1738c05b-4a1d-4a1c-8845-0b28fe6c81bb" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.121856] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1738c05b-4a1d-4a1c-8845-0b28fe6c81bb" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.121856] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1738c05b-4a1d-4a1c-8845-0b28fe6c81bb" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.121856] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1738c05b-4a1d-4a1c-8845-0b28fe6c81bb',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.389130] env[62842]: INFO networking_nsxv3.common.synchronization [None req-e621fe83-a9cb-474e-b742-45fe3d6492f7 None None] Enqueued Resource ID: 0eed2231-afa1-4c40-b846-0856ce3843be with Priority: HIGHEST for action port [ 1111.389130] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0eed2231-afa1-4c40-b846-0856ce3843be with Priority: HIGHEST for action port [ 1111.389130] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-0eed2231-afa1-4c40-b846-0856ce3843be taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.389130] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0eed2231-afa1-4c40-b846-0856ce3843be" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.389130] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0eed2231-afa1-4c40-b846-0856ce3843be" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.389130] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0eed2231-afa1-4c40-b846-0856ce3843be" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.389130] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0eed2231-afa1-4c40-b846-0856ce3843be',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.585319] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d049bd9-2d2b-49fc-98b0-e67bd0e7171b in Status: SUCCESS [ 1111.585319] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d049bd9-2d2b-49fc-98b0-e67bd0e7171b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.585319] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d049bd9-2d2b-49fc-98b0-e67bd0e7171b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.585319] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d049bd9-2d2b-49fc-98b0-e67bd0e7171b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.585319] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.585319] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.585319] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.585319] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.585319] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.585641] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d049bd9-2d2b-49fc-98b0-e67bd0e7171b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.585641] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0d049bd9-2d2b-49fc-98b0-e67bd0e7171b',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.646766] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.647669] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.647669] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.647669] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.647669] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.647669] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1738c05b-4a1d-4a1c-8845-0b28fe6c81bb already deleted. [ 1111.647669] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1738c05b-4a1d-4a1c-8845-0b28fe6c81bb" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.894114] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0eed2231-afa1-4c40-b846-0856ce3843be [ 1111.894452] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.894599] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.894670] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.894970] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.895089] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.895192] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0eed2231-afa1-4c40-b846-0856ce3843be already deleted. [ 1111.895277] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0eed2231-afa1-4c40-b846-0856ce3843be" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.067887] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-416 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.068146] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-416" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.068276] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-416" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.068553] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-416" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.068829] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.068981] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.069184] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.069408] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.069566] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.069783] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1112.070200] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1112.070330] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1112.070444] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1112.070562] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1112.070671] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1112.070808] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1112.088250] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d049bd9-2d2b-49fc-98b0-e67bd0e7171b taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.088475] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d049bd9-2d2b-49fc-98b0-e67bd0e7171b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.088569] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d049bd9-2d2b-49fc-98b0-e67bd0e7171b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.088891] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d049bd9-2d2b-49fc-98b0-e67bd0e7171b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.089485] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.089485] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.089485] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.089678] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.089777] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.089843] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d049bd9-2d2b-49fc-98b0-e67bd0e7171b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.089999] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d049bd9-2d2b-49fc-98b0-e67bd0e7171b taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.090131] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d049bd9-2d2b-49fc-98b0-e67bd0e7171b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.090233] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d049bd9-2d2b-49fc-98b0-e67bd0e7171b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.090449] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d049bd9-2d2b-49fc-98b0-e67bd0e7171b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.090607] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.090704] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.090763] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.090909] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.091033] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.091124] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d049bd9-2d2b-49fc-98b0-e67bd0e7171b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.091244] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0d049bd9-2d2b-49fc-98b0-e67bd0e7171b',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.093427] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1112.093594] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1112.093728] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1112.093895] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-416" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.094221] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-967910ad-c991-48e5-a871-5e301e8992e0 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.094437] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-967910ad-c991-48e5-a871-5e301e8992e0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.094857] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-967910ad-c991-48e5-a871-5e301e8992e0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.094857] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-967910ad-c991-48e5-a871-5e301e8992e0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.094989] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('967910ad-c991-48e5-a871-5e301e8992e0',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.598694] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0d049bd9-2d2b-49fc-98b0-e67bd0e7171b: rpc.has_security_group_logging(os_id): False [ 1112.602142] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.602423] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.602639] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.603086] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.603336] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.603590] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 967910ad-c991-48e5-a871-5e301e8992e0 not found, creating... [ 1112.604136] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.604381] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.608022] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.609211] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.609298] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.609825] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.610121] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.610323] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.610733] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.610947] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.611202] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 967910ad-c991-48e5-a871-5e301e8992e0 is going to be created. [ 1112.648679] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.649045] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.649045] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.649395] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.649395] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.649481] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.649548] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.649608] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.649756] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.649833] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.650097] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.650185] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.650219] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.650903] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.650903] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.650903] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.650903] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.650903] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.651248] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.651248] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.653934] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0d049bd9-2d2b-49fc-98b0-e67bd0e7171b is going to be created. [ 1112.659476] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.659826] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.660052] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.660471] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.660824] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.661207] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-967910ad-c991-48e5-a871-5e301e8992e0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.811048] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.811498] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.811498] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.811629] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.811828] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.841501] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0d049bd9-2d2b-49fc-98b0-e67bd0e7171b in Status: IN_PROGRESS for 2s [ 1113.324988] env[62842]: INFO networking_nsxv3.common.synchronization [req-249a9e44-8599-4ed7-b192-5776743c12c8 req-fc574d3c-b18f-4e52-9b59-3b16bc5a6e5a service nova] Enqueued Resource ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 with Priority: HIGHEST for action security_group_rules [ 1113.325956] env[62842]: INFO networking_nsxv3.common.synchronization [req-249a9e44-8599-4ed7-b192-5776743c12c8 req-fc574d3c-b18f-4e52-9b59-3b16bc5a6e5a service nova] Enqueued Resource ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 with Priority: HIGHEST for action security_group_members [ 1113.326280] env[62842]: INFO networking_nsxv3.common.synchronization [req-249a9e44-8599-4ed7-b192-5776743c12c8 req-fc574d3c-b18f-4e52-9b59-3b16bc5a6e5a service nova] Enqueued Resource ID: 967910ad-c991-48e5-a871-5e301e8992e0 with Priority: HIGHEST for action port [ 1113.328919] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 with Priority: HIGHEST for action security_group_rules [ 1113.328919] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 with Priority: HIGHEST for action security_group_members [ 1113.328919] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 967910ad-c991-48e5-a871-5e301e8992e0 with Priority: HIGHEST for action port [ 1113.328919] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.328919] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.328919] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.328919] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.328919] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('77637a7d-8eb8-4f0e-a5bd-9870e0d191c6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.328919] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.329372] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.329867] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.329945] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.330135] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.330244] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.330317] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.330483] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.330573] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.330666] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77637a7d-8eb8-4f0e-a5bd-9870e0d191c6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.333069] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-967910ad-c991-48e5-a871-5e301e8992e0 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.333178] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-967910ad-c991-48e5-a871-5e301e8992e0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.333305] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-967910ad-c991-48e5-a871-5e301e8992e0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.333417] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-967910ad-c991-48e5-a871-5e301e8992e0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.333498] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('967910ad-c991-48e5-a871-5e301e8992e0',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.774241] env[62842]: INFO networking_nsxv3.common.synchronization [req-67e6fee0-cb4b-4b44-a77c-150f8a8aae1c req-da10c51f-f6f7-4c21-bd5b-af505ac5266e tempest-ServersTestJSON-1267616671 tempest-ServersTestJSON-1267616671-project-member] Enqueued Resource ID: 074be4e0-ffc9-4ec9-b29a-40406844218c with Priority: HIGHEST for action security_group_members [ 1113.774947] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 074be4e0-ffc9-4ec9-b29a-40406844218c with Priority: HIGHEST for action security_group_members [ 1113.775208] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-074be4e0-ffc9-4ec9-b29a-40406844218c taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.775336] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.775410] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.775605] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.775762] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.775861] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.775925] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.777443] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.777559] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.777693] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.836603] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('77637a7d-8eb8-4f0e-a5bd-9870e0d191c6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.836603] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.836603] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.836603] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 967910ad-c991-48e5-a871-5e301e8992e0 with status ACTIVE [ 1113.836603] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.836603] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.836603] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.836603] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.836603] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.836603] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.837074] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.837074] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.837074] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.837074] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.837074] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.837378] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.837378] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.837445] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.839260] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.839260] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 967910ad-c991-48e5-a871-5e301e8992e0 is going to be updated. [ 1113.861986] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.861986] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.861986] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.862234] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.862234] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.862408] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-967910ad-c991-48e5-a871-5e301e8992e0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.281080] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.336642] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('77637a7d-8eb8-4f0e-a5bd-9870e0d191c6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.786784] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.841309] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.841309] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.841309] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.841676] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.841840] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.842458] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 is going to be updated. [ 1114.861419] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0d049bd9-2d2b-49fc-98b0-e67bd0e7171b in Status: SUCCESS [ 1114.861875] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0d049bd9-2d2b-49fc-98b0-e67bd0e7171b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.877953] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.878276] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.878388] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.878576] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.878723] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.889587] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 in Status: IN_PROGRESS for 2s [ 1115.289369] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.289608] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.289752] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.290279] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.290379] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.290538] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 074be4e0-ffc9-4ec9-b29a-40406844218c is going to be updated. [ 1115.345786] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.346013] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.346013] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.346236] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.346809] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.358382] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 074be4e0-ffc9-4ec9-b29a-40406844218c in Status: IN_PROGRESS for 2s [ 1116.900930] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 in Status: SUCCESS [ 1116.901944] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.901944] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.901944] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.902670] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.902670] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.902670] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.902670] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.902670] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.902670] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.903205] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('77637a7d-8eb8-4f0e-a5bd-9870e0d191c6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.369711] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 074be4e0-ffc9-4ec9-b29a-40406844218c in Status: SUCCESS [ 1117.369711] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.406090] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.406243] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.406243] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.406461] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.406628] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.406726] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.406789] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.406939] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.407036] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.407125] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.407273] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.407363] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.407423] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.407559] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.407692] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.407781] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.407866] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.407985] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.408063] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.408144] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.408230] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('77637a7d-8eb8-4f0e-a5bd-9870e0d191c6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.911443] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6: rpc.has_security_group_logging(os_id): False [ 1117.930758] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.930941] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.930992] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.931296] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.931503] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.931722] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.931826] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.932190] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.932434] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.932550] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.932976] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.933141] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.933211] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.933419] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.933515] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.933725] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.933921] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.933921] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.934042] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.934124] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.934213] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 is going to be updated. [ 1118.008254] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.008348] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.008398] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.008613] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.008763] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.035025] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 in Status: IN_PROGRESS for 2s [ 1118.776355] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1118.776355] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1119.408942] env[62842]: INFO networking_nsxv3.common.synchronization [None req-eeabfced-88a8-40be-b9a7-ddfd4921be72 None None] Enqueued Resource ID: 9f7dbaf9-fa0f-488b-a5c3-b869a2349301 with Priority: HIGHEST for action port [ 1119.409508] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f7dbaf9-fa0f-488b-a5c3-b869a2349301 with Priority: HIGHEST for action port [ 1119.409562] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-9f7dbaf9-fa0f-488b-a5c3-b869a2349301 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.409745] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9f7dbaf9-fa0f-488b-a5c3-b869a2349301" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.409838] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9f7dbaf9-fa0f-488b-a5c3-b869a2349301" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.410458] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9f7dbaf9-fa0f-488b-a5c3-b869a2349301" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.410608] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f7dbaf9-fa0f-488b-a5c3-b869a2349301',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.918100] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9f7dbaf9-fa0f-488b-a5c3-b869a2349301 [ 1119.918327] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.918454] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.918520] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.918843] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.918999] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.919173] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9f7dbaf9-fa0f-488b-a5c3-b869a2349301 already deleted. [ 1119.919317] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9f7dbaf9-fa0f-488b-a5c3-b869a2349301" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.053299] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 in Status: SUCCESS [ 1120.053587] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.060834] env[62842]: INFO networking_nsxv3.common.synchronization [req-a5a351bb-11d0-4523-a2d0-326d409d5345 req-7374f86e-4aca-437a-8d61-6833b11f6d2c tempest-ServerRescueNegativeTestJSON-1880350091 tempest-ServerRescueNegativeTestJSON-1880350091-project-member] Enqueued Resource ID: 1744456a-cfb4-4022-aed6-d7e18e95179b with Priority: HIGHEST for action security_group_members [ 1120.061413] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1744456a-cfb4-4022-aed6-d7e18e95179b with Priority: HIGHEST for action security_group_members [ 1120.061728] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-1744456a-cfb4-4022-aed6-d7e18e95179b taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.062914] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1744456a-cfb4-4022-aed6-d7e18e95179b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.062914] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1744456a-cfb4-4022-aed6-d7e18e95179b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.063633] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1744456a-cfb4-4022-aed6-d7e18e95179b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.064038] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.064038] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.064038] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.064267] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.064332] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.066803] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1744456a-cfb4-4022-aed6-d7e18e95179b',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.566698] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.567027] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.567027] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.568339] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.568339] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.568339] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.568339] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.568339] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.568339] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.568339] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.568339] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1744456a-cfb4-4022-aed6-d7e18e95179b is going to be updated. [ 1120.612960] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.612960] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.612960] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.612960] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.613208] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.624439] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1744456a-cfb4-4022-aed6-d7e18e95179b in Status: IN_PROGRESS for 2s [ 1121.401540] env[62842]: INFO networking_nsxv3.common.synchronization [req-be323398-6120-4386-afcf-5ace664c9eb0 req-b4a5c027-9e80-4013-9e9a-6596ea4dd6c4 tempest-ServerMetadataTestJSON-1251833882 tempest-ServerMetadataTestJSON-1251833882-project-member] Enqueued Resource ID: 0d049bd9-2d2b-49fc-98b0-e67bd0e7171b with Priority: HIGHEST for action security_group_members [ 1121.402221] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d049bd9-2d2b-49fc-98b0-e67bd0e7171b with Priority: HIGHEST for action security_group_members [ 1121.402636] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d049bd9-2d2b-49fc-98b0-e67bd0e7171b taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.402805] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d049bd9-2d2b-49fc-98b0-e67bd0e7171b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.402886] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d049bd9-2d2b-49fc-98b0-e67bd0e7171b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.405919] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d049bd9-2d2b-49fc-98b0-e67bd0e7171b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.405990] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.406125] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.406220] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.406422] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.406530] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.406633] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d049bd9-2d2b-49fc-98b0-e67bd0e7171b',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.901432] env[62842]: INFO networking_nsxv3.common.synchronization [req-5edfddfa-89df-46ad-bb09-b2ec47490fbe req-af71aa7b-82ad-4ded-baf7-4896647475ca tempest-ServersTestJSON-1267616671 tempest-ServersTestJSON-1267616671-project-member] Enqueued Resource ID: 074be4e0-ffc9-4ec9-b29a-40406844218c with Priority: HIGHEST for action security_group_members [ 1121.902529] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 074be4e0-ffc9-4ec9-b29a-40406844218c with Priority: HIGHEST for action security_group_members [ 1121.903117] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-074be4e0-ffc9-4ec9-b29a-40406844218c taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.903117] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.903279] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.903522] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.903756] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.904054] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.904054] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.908025] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.908025] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.908025] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.911360] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.911490] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.911558] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.911795] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.911882] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.912109] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.912577] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.912711] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.913069] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.913222] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.913358] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d049bd9-2d2b-49fc-98b0-e67bd0e7171b is going to be updated. [ 1121.947593] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.947865] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.947865] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.947978] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.948221] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.958523] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d049bd9-2d2b-49fc-98b0-e67bd0e7171b in Status: IN_PROGRESS for 2s [ 1121.967419] env[62842]: INFO networking_nsxv3.common.synchronization [None req-0581ff26-7d78-4992-905e-e46982800044 None None] Enqueued Resource ID: 842f80a6-abb4-451f-9397-58365771b102 with Priority: HIGHEST for action port [ 1121.967419] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 842f80a6-abb4-451f-9397-58365771b102 with Priority: HIGHEST for action port [ 1121.967419] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-842f80a6-abb4-451f-9397-58365771b102 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.967419] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-842f80a6-abb4-451f-9397-58365771b102" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.967419] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-842f80a6-abb4-451f-9397-58365771b102" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.967419] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-842f80a6-abb4-451f-9397-58365771b102" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.967419] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('842f80a6-abb4-451f-9397-58365771b102',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.408061] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.468969] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 842f80a6-abb4-451f-9397-58365771b102 [ 1122.469256] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.469415] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.469509] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.469816] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.469986] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.470168] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:842f80a6-abb4-451f-9397-58365771b102 already deleted. [ 1122.470399] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-842f80a6-abb4-451f-9397-58365771b102" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.635930] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1744456a-cfb4-4022-aed6-d7e18e95179b in Status: SUCCESS [ 1122.636115] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1744456a-cfb4-4022-aed6-d7e18e95179b deletion is rescheduled due to dependency. [ 1122.636292] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1744456a-cfb4-4022-aed6-d7e18e95179b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.913428] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.152953] env[62842]: INFO networking_nsxv3.common.synchronization [req-c2b980a4-c6a3-45c9-94d5-fc8050aa19fb req-d765892e-231b-4324-8ad2-1525803d9423 tempest-ServerActionsTestJSON-670456711 tempest-ServerActionsTestJSON-670456711-project-member] Enqueued Resource ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 with Priority: HIGHEST for action security_group_members [ 1123.153505] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 with Priority: HIGHEST for action security_group_members [ 1123.153828] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a03224f-b75b-48a5-9e23-3ca50aabbb33 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.155192] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.155192] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.155434] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.155605] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.155713] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.155774] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.156053] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.156101] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.156933] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a03224f-b75b-48a5-9e23-3ca50aabbb33',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.415861] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.416089] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.416191] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.416438] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.416575] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.416695] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 074be4e0-ffc9-4ec9-b29a-40406844218c is going to be updated. [ 1123.447058] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.447058] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.447058] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.447335] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.447335] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.457765] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 074be4e0-ffc9-4ec9-b29a-40406844218c in Status: IN_PROGRESS for 2s [ 1123.662029] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.662029] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.662029] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.662029] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.662029] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.662029] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.662029] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.662029] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.662029] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.662029] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.662029] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 is going to be updated. [ 1123.690240] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.690425] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.690497] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.690731] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.690931] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.701668] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 in Status: IN_PROGRESS for 2s [ 1123.968843] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d049bd9-2d2b-49fc-98b0-e67bd0e7171b in Status: SUCCESS [ 1123.969150] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d049bd9-2d2b-49fc-98b0-e67bd0e7171b deletion is rescheduled due to dependency. [ 1123.969150] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d049bd9-2d2b-49fc-98b0-e67bd0e7171b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.285808] env[62842]: INFO networking_nsxv3.common.synchronization [req-b1c0749d-2969-4b36-b742-773e6e372fad req-89df8324-266b-4500-b501-10f336377999 tempest-ServerActionsTestOtherA-1611322165 tempest-ServerActionsTestOtherA-1611322165-project-member] Enqueued Resource ID: 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 with Priority: HIGHEST for action security_group_members [ 1124.286532] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 with Priority: HIGHEST for action security_group_members [ 1124.286883] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.287011] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.287063] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.287264] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.287411] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.287501] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.287555] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.287701] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.287786] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.287878] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.791248] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.297166] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.470834] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 074be4e0-ffc9-4ec9-b29a-40406844218c in Status: SUCCESS [ 1125.471032] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.712631] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 in Status: IN_PROGRESS for 4s [ 1125.800477] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.800677] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.800745] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.801380] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.801380] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.801380] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 is going to be updated. [ 1125.913971] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.913971] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.913971] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.913971] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.913971] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.921982] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 in Status: IN_PROGRESS for 2s [ 1127.724960] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 in Status: SUCCESS [ 1127.724960] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 deletion is rescheduled due to dependency. [ 1127.724960] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.868027] env[62842]: INFO networking_nsxv3.common.synchronization [req-27d0fe22-c00d-43c6-8125-721291e21caf req-0574b9eb-b01b-4cbf-8ac1-b0bafb9bf64a tempest-InstanceActionsV221TestJSON-209202169 tempest-InstanceActionsV221TestJSON-209202169-project-member] Enqueued Resource ID: a9fd4555-77cd-4151-9f34-13bead661429 with Priority: HIGHEST for action security_group_members [ 1127.868027] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9fd4555-77cd-4151-9f34-13bead661429 with Priority: HIGHEST for action security_group_members [ 1127.868027] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9fd4555-77cd-4151-9f34-13bead661429 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.868027] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9fd4555-77cd-4151-9f34-13bead661429" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.868027] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9fd4555-77cd-4151-9f34-13bead661429" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.868027] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9fd4555-77cd-4151-9f34-13bead661429" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.868027] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.868027] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.868027] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.868027] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.868027] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.868027] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9fd4555-77cd-4151-9f34-13bead661429',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.934703] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 in Status: SUCCESS [ 1127.934926] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.141500] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-193 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.141714] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-193" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.141840] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-193" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.142282] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-193" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.142518] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.142682] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.142802] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.143079] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.143414] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.143509] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1128.143595] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1128.143710] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1128.143817] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1128.143926] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1128.144044] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1128.144196] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1128.164190] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1128.164392] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1128.164520] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1128.164695] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-193" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.165037] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-f447a434-7130-47d7-9e24-52a4fa387754 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.165256] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-f447a434-7130-47d7-9e24-52a4fa387754" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.165391] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-f447a434-7130-47d7-9e24-52a4fa387754" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.165727] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-f447a434-7130-47d7-9e24-52a4fa387754" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.165873] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f447a434-7130-47d7-9e24-52a4fa387754',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.372362] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.372531] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.372604] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.372820] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.372911] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.373474] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.373474] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.373789] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.373789] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.373789] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.373898] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9fd4555-77cd-4151-9f34-13bead661429 already deleted. [ 1128.373933] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9fd4555-77cd-4151-9f34-13bead661429" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.668304] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.668304] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.668304] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.668600] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.669203] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.669203] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port f447a434-7130-47d7-9e24-52a4fa387754 not found, creating... [ 1128.669203] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.669418] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.669462] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.669677] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.669815] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.670164] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.670327] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.670446] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.670651] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.670787] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.670923] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: f447a434-7130-47d7-9e24-52a4fa387754 is going to be created. [ 1128.697021] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.697021] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.697021] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.697021] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.697021] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.697021] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-f447a434-7130-47d7-9e24-52a4fa387754" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.644416] env[62842]: INFO networking_nsxv3.common.synchronization [req-27d0fe22-c00d-43c6-8125-721291e21caf req-6d08223b-3729-4e1f-b605-e727c5aafa08 service nova] Enqueued Resource ID: a9fd4555-77cd-4151-9f34-13bead661429 with Priority: HIGHEST for action security_group_rules [ 1129.644416] env[62842]: INFO networking_nsxv3.common.synchronization [req-27d0fe22-c00d-43c6-8125-721291e21caf req-6d08223b-3729-4e1f-b605-e727c5aafa08 service nova] Enqueued Resource ID: a9fd4555-77cd-4151-9f34-13bead661429 with Priority: HIGHEST for action security_group_members [ 1129.644416] env[62842]: INFO networking_nsxv3.common.synchronization [req-27d0fe22-c00d-43c6-8125-721291e21caf req-6d08223b-3729-4e1f-b605-e727c5aafa08 service nova] Enqueued Resource ID: f447a434-7130-47d7-9e24-52a4fa387754 with Priority: HIGHEST for action port [ 1129.644416] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9fd4555-77cd-4151-9f34-13bead661429 with Priority: HIGHEST for action security_group_rules [ 1129.644416] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9fd4555-77cd-4151-9f34-13bead661429 with Priority: HIGHEST for action security_group_members [ 1129.644416] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f447a434-7130-47d7-9e24-52a4fa387754 with Priority: HIGHEST for action port [ 1129.644416] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9fd4555-77cd-4151-9f34-13bead661429 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.644416] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9fd4555-77cd-4151-9f34-13bead661429" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.644416] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9fd4555-77cd-4151-9f34-13bead661429" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.644416] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9fd4555-77cd-4151-9f34-13bead661429" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.644416] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9fd4555-77cd-4151-9f34-13bead661429',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.645340] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9fd4555-77cd-4151-9f34-13bead661429 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.645340] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9fd4555-77cd-4151-9f34-13bead661429" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.645340] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9fd4555-77cd-4151-9f34-13bead661429" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.645340] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9fd4555-77cd-4151-9f34-13bead661429" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.645340] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.645340] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.645340] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.645340] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.645792] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.645792] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9fd4555-77cd-4151-9f34-13bead661429',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.646303] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-f447a434-7130-47d7-9e24-52a4fa387754 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.646458] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f447a434-7130-47d7-9e24-52a4fa387754" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.646458] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f447a434-7130-47d7-9e24-52a4fa387754" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.646611] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f447a434-7130-47d7-9e24-52a4fa387754" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.650023] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f447a434-7130-47d7-9e24-52a4fa387754',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.933454] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-416 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.933852] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-416" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.934031] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-416" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.934499] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-416" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.934753] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.935997] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.936206] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.936492] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.936730] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.936948] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1129.937135] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1129.937486] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1129.937582] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1129.937728] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1129.937870] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1129.938052] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1129.958683] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1129.958845] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1129.958943] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1129.959150] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-416" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.959477] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-967910ad-c991-48e5-a871-5e301e8992e0 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.959656] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-967910ad-c991-48e5-a871-5e301e8992e0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.959780] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-967910ad-c991-48e5-a871-5e301e8992e0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.960129] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-967910ad-c991-48e5-a871-5e301e8992e0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.960278] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('967910ad-c991-48e5-a871-5e301e8992e0',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.148465] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9fd4555-77cd-4151-9f34-13bead661429 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.148465] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9fd4555-77cd-4151-9f34-13bead661429" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.148695] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a9fd4555-77cd-4151-9f34-13bead661429',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.149830] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f447a434-7130-47d7-9e24-52a4fa387754 with status ACTIVE [ 1130.150044] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.150168] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.150237] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.150435] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.150523] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.150692] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.150787] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.150869] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.150991] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.151841] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.152023] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.152166] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.152424] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.152647] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.152761] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.152853] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f447a434-7130-47d7-9e24-52a4fa387754 is going to be updated. [ 1130.174626] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.174626] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.174626] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.174626] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.174626] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.174904] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f447a434-7130-47d7-9e24-52a4fa387754" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.462869] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.463033] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.463224] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.463712] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.463712] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.463920] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.464093] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.464216] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.464506] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.464659] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.464947] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.465149] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.465274] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.465493] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.465617] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.465762] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 967910ad-c991-48e5-a871-5e301e8992e0 is going to be updated. [ 1130.490568] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.490568] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.490568] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.491126] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.491379] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.491656] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-967910ad-c991-48e5-a871-5e301e8992e0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.655113] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a9fd4555-77cd-4151-9f34-13bead661429',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.158181] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.158311] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.158311] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.158525] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.158622] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.158719] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9fd4555-77cd-4151-9f34-13bead661429 is going to be created. [ 1131.183644] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.183871] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.183871] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.184068] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.184232] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.193604] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9fd4555-77cd-4151-9f34-13bead661429 in Status: UNINITIALIZED for 2s [ 1131.678679] env[62842]: INFO networking_nsxv3.common.synchronization [req-dcf7a479-0345-4ca4-8b00-2cab60da6448 req-68ece0df-9703-4929-b4b9-653598fa2bb5 service nova] Enqueued Resource ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 with Priority: HIGHEST for action security_group_rules [ 1131.679028] env[62842]: INFO networking_nsxv3.common.synchronization [req-dcf7a479-0345-4ca4-8b00-2cab60da6448 req-68ece0df-9703-4929-b4b9-653598fa2bb5 service nova] Enqueued Resource ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 with Priority: HIGHEST for action security_group_members [ 1131.680913] env[62842]: INFO networking_nsxv3.common.synchronization [req-dcf7a479-0345-4ca4-8b00-2cab60da6448 req-68ece0df-9703-4929-b4b9-653598fa2bb5 service nova] Enqueued Resource ID: 967910ad-c991-48e5-a871-5e301e8992e0 with Priority: HIGHEST for action port [ 1131.681848] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 with Priority: HIGHEST for action security_group_rules [ 1131.682127] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 with Priority: HIGHEST for action security_group_members [ 1131.682326] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 967910ad-c991-48e5-a871-5e301e8992e0 with Priority: HIGHEST for action port [ 1131.682797] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.683051] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.683124] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.683435] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.683568] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('77637a7d-8eb8-4f0e-a5bd-9870e0d191c6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.685377] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.685584] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.685768] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.685983] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.686492] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.686492] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.686690] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.686902] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.689293] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.689293] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77637a7d-8eb8-4f0e-a5bd-9870e0d191c6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.689293] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-967910ad-c991-48e5-a871-5e301e8992e0 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.689293] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-967910ad-c991-48e5-a871-5e301e8992e0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.689293] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-967910ad-c991-48e5-a871-5e301e8992e0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.689293] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-967910ad-c991-48e5-a871-5e301e8992e0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.689293] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('967910ad-c991-48e5-a871-5e301e8992e0',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.191277] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.191441] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.191632] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('77637a7d-8eb8-4f0e-a5bd-9870e0d191c6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.192586] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 967910ad-c991-48e5-a871-5e301e8992e0 with status ACTIVE [ 1132.193167] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.193167] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.193167] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.193167] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.193408] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.193445] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.193534] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.193585] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.193947] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.193947] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.194063] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.194114] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.194144] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.194270] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.194347] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.194428] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 967910ad-c991-48e5-a871-5e301e8992e0 is going to be updated. [ 1132.217761] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.217928] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.217986] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.218212] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.218379] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.218554] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-967910ad-c991-48e5-a871-5e301e8992e0" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.699266] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('77637a7d-8eb8-4f0e-a5bd-9870e0d191c6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.908041] env[62842]: INFO networking_nsxv3.common.synchronization [req-032e1be0-b406-48c3-9e1b-0186c4a8dd22 req-56f58285-7f3a-408b-a14f-f42e40fac47d tempest-ServerRescueNegativeTestJSON-1880350091 tempest-ServerRescueNegativeTestJSON-1880350091-project-member] Enqueued Resource ID: ea061614-3b2c-4a61-a74b-32a4b42f10a1 with Priority: HIGHEST for action security_group_members [ 1132.908384] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea061614-3b2c-4a61-a74b-32a4b42f10a1 with Priority: HIGHEST for action security_group_members [ 1132.908697] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea061614-3b2c-4a61-a74b-32a4b42f10a1 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.908815] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.908881] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.909098] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.909948] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.909948] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.909948] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.909948] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.909948] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.909948] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea061614-3b2c-4a61-a74b-32a4b42f10a1',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.201764] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.201910] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.202046] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.202267] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.202361] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.202459] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 is going to be updated. [ 1133.204111] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9fd4555-77cd-4151-9f34-13bead661429 in Status: SUCCESS [ 1133.204386] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9fd4555-77cd-4151-9f34-13bead661429" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.204556] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9fd4555-77cd-4151-9f34-13bead661429" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.204729] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9fd4555-77cd-4151-9f34-13bead661429" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.204894] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.204998] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.205073] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.205213] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.205288] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.205370] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9fd4555-77cd-4151-9f34-13bead661429" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.205455] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a9fd4555-77cd-4151-9f34-13bead661429',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.234519] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.234744] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.234820] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.235858] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.235858] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.245792] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 in Status: IN_PROGRESS for 2s [ 1133.411956] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ea061614-3b2c-4a61-a74b-32a4b42f10a1',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.710121] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9fd4555-77cd-4151-9f34-13bead661429 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.710491] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9fd4555-77cd-4151-9f34-13bead661429" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.710491] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9fd4555-77cd-4151-9f34-13bead661429" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.710615] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9fd4555-77cd-4151-9f34-13bead661429" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.711094] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.711094] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.711094] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.711094] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.711401] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.711401] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9fd4555-77cd-4151-9f34-13bead661429" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.711401] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9fd4555-77cd-4151-9f34-13bead661429 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.711566] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9fd4555-77cd-4151-9f34-13bead661429" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.711566] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9fd4555-77cd-4151-9f34-13bead661429" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.711664] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9fd4555-77cd-4151-9f34-13bead661429" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.711813] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.711896] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.711971] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.712204] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.712301] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.712469] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9fd4555-77cd-4151-9f34-13bead661429" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.712601] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a9fd4555-77cd-4151-9f34-13bead661429',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.841135] env[62842]: INFO networking_nsxv3.common.synchronization [req-19360a31-d964-4fe9-a6fd-4a6e4e5fb883 req-75098c1d-5487-45c8-8073-fc4e265fc852 tempest-ImagesTestJSON-1786483082 tempest-ImagesTestJSON-1786483082-project-member] Enqueued Resource ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 with Priority: HIGHEST for action security_group_members [ 1133.841135] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 with Priority: HIGHEST for action security_group_members [ 1133.841588] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e26630c-b3f7-4b48-9720-77b59135adf4 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.841588] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.841588] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.841839] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.841935] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.842661] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.842661] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.842767] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.842835] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.842967] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e26630c-b3f7-4b48-9720-77b59135adf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.914290] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ea061614-3b2c-4a61-a74b-32a4b42f10a1',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.182573] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-41 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.182810] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-41" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.182937] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-41" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.183237] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-41" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.183511] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.183673] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.183794] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.184015] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.185668] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.185928] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1134.186066] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1134.186220] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1134.186346] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1134.186468] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1134.186582] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1134.186723] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1134.208481] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1134.208481] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1134.209484] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1134.209484] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-41" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.209484] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-fd1ca31e-50fa-43f1-add7-10482eb6b695 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.209484] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-fd1ca31e-50fa-43f1-add7-10482eb6b695" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.209484] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-fd1ca31e-50fa-43f1-add7-10482eb6b695" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.209869] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-fd1ca31e-50fa-43f1-add7-10482eb6b695" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.210053] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd1ca31e-50fa-43f1-add7-10482eb6b695',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.214188] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a9fd4555-77cd-4151-9f34-13bead661429: rpc.has_security_group_logging(os_id): False [ 1134.235427] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.235716] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.235716] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.235864] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.235936] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.236154] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.236284] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.236401] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.236515] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.236592] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.236850] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.236926] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.236926] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.237089] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.237166] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.237345] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.237436] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.237505] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.237650] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.237723] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.237813] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9fd4555-77cd-4151-9f34-13bead661429 is going to be created. [ 1134.344325] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.344415] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.344451] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.344651] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.344830] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.347743] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e26630c-b3f7-4b48-9720-77b59135adf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.363029] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9fd4555-77cd-4151-9f34-13bead661429 in Status: IN_PROGRESS for 2s [ 1134.417048] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.417368] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.417484] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.417793] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.417901] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.418075] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea061614-3b2c-4a61-a74b-32a4b42f10a1 is going to be updated. [ 1134.465357] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.465573] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.465573] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.465785] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.465929] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.477510] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea061614-3b2c-4a61-a74b-32a4b42f10a1 in Status: IN_PROGRESS for 2s [ 1134.717062] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.717062] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.717062] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.717062] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.717533] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.717533] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port fd1ca31e-50fa-43f1-add7-10482eb6b695 not found, creating... [ 1134.717673] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.717837] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.718047] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.718223] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.718366] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.718656] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.718941] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.719112] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.719331] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.719472] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.719618] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: fd1ca31e-50fa-43f1-add7-10482eb6b695 is going to be created. [ 1134.740421] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.740634] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.740761] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.741045] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.741336] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.741505] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-fd1ca31e-50fa-43f1-add7-10482eb6b695" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.850614] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e26630c-b3f7-4b48-9720-77b59135adf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.256971] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 in Status: SUCCESS [ 1135.257209] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.257595] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.257595] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.257776] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.257892] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.258025] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.258163] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.258223] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.258277] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.258363] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('77637a7d-8eb8-4f0e-a5bd-9870e0d191c6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.354924] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.354924] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.354924] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.354924] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.354924] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.354924] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 is going to be updated. [ 1135.384078] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.384078] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.384078] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.384078] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.384078] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.393086] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 in Status: IN_PROGRESS for 2s [ 1135.471155] env[62842]: INFO networking_nsxv3.common.synchronization [req-19360a31-d964-4fe9-a6fd-4a6e4e5fb883 req-f5e22279-2597-4b89-9cc5-d13b63c3658b service nova] Enqueued Resource ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 with Priority: HIGHEST for action security_group_rules [ 1135.471396] env[62842]: INFO networking_nsxv3.common.synchronization [req-19360a31-d964-4fe9-a6fd-4a6e4e5fb883 req-f5e22279-2597-4b89-9cc5-d13b63c3658b service nova] Enqueued Resource ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 with Priority: HIGHEST for action security_group_members [ 1135.471570] env[62842]: INFO networking_nsxv3.common.synchronization [req-19360a31-d964-4fe9-a6fd-4a6e4e5fb883 req-f5e22279-2597-4b89-9cc5-d13b63c3658b service nova] Enqueued Resource ID: fd1ca31e-50fa-43f1-add7-10482eb6b695 with Priority: HIGHEST for action port [ 1135.472257] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 with Priority: HIGHEST for action security_group_rules [ 1135.472459] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 with Priority: HIGHEST for action security_group_members [ 1135.472619] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd1ca31e-50fa-43f1-add7-10482eb6b695 with Priority: HIGHEST for action port [ 1135.472959] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e26630c-b3f7-4b48-9720-77b59135adf4 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.473160] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.473254] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.473520] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.473596] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e26630c-b3f7-4b48-9720-77b59135adf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.474651] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e26630c-b3f7-4b48-9720-77b59135adf4 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.474801] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.475038] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd1ca31e-50fa-43f1-add7-10482eb6b695 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.475202] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd1ca31e-50fa-43f1-add7-10482eb6b695" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.475318] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd1ca31e-50fa-43f1-add7-10482eb6b695" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.475529] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd1ca31e-50fa-43f1-add7-10482eb6b695" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.475631] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd1ca31e-50fa-43f1-add7-10482eb6b695',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.761089] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.761518] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.761518] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.761593] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.761735] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.761841] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.761904] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.762089] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.762180] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.762271] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.762420] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.762533] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.762609] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.762792] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.762948] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.763068] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.763133] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.763271] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.763346] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.763428] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.763517] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('77637a7d-8eb8-4f0e-a5bd-9870e0d191c6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.977783] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e26630c-b3f7-4b48-9720-77b59135adf4 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.977903] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.979236] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fd1ca31e-50fa-43f1-add7-10482eb6b695 with status ACTIVE [ 1135.979406] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.979637] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.979637] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.979779] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.979866] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.980182] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.980304] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.980336] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.980493] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.980562] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.980741] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.980831] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.980887] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.981030] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.981108] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.981188] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fd1ca31e-50fa-43f1-add7-10482eb6b695 is going to be updated. [ 1136.003702] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.003867] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.003929] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.004252] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.004408] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.004562] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd1ca31e-50fa-43f1-add7-10482eb6b695" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.265660] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6: rpc.has_security_group_logging(os_id): False [ 1136.284668] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.284866] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.284911] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.285198] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.285308] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.285526] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.285629] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.285692] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.285885] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.285965] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.286194] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.286318] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.286383] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.286530] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.286606] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.286801] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.286894] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.286954] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.287108] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.287185] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.287270] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 is going to be updated. [ 1136.374802] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.374996] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.374996] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.375279] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.375443] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.377173] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9fd4555-77cd-4151-9f34-13bead661429 in Status: SUCCESS [ 1136.377401] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9fd4555-77cd-4151-9f34-13bead661429" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.388318] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 in Status: IN_PROGRESS for 2s [ 1136.491175] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea061614-3b2c-4a61-a74b-32a4b42f10a1 in Status: SUCCESS [ 1136.491175] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.404226] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 in Status: SUCCESS [ 1137.404611] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.404611] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.404830] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.405025] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.405146] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.405211] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.405365] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.405443] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.405538] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e26630c-b3f7-4b48-9720-77b59135adf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.907920] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e26630c-b3f7-4b48-9720-77b59135adf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.404923] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 in Status: SUCCESS [ 1138.404923] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.413493] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e26630c-b3f7-4b48-9720-77b59135adf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.743051] env[62842]: INFO networking_nsxv3.common.synchronization [req-fa64119e-d370-4c4d-84f9-6bf1b24968fa req-a00325ac-1948-48bc-b3d3-a9e40aa40a97 tempest-ServerActionsV293TestJSON-861524001 tempest-ServerActionsV293TestJSON-861524001-project-member] Enqueued Resource ID: 1738c05b-4a1d-4a1c-8845-0b28fe6c81bb with Priority: HIGHEST for action security_group_members [ 1138.743806] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1738c05b-4a1d-4a1c-8845-0b28fe6c81bb with Priority: HIGHEST for action security_group_members [ 1138.744602] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-1738c05b-4a1d-4a1c-8845-0b28fe6c81bb taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.744602] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1738c05b-4a1d-4a1c-8845-0b28fe6c81bb" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.744602] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1738c05b-4a1d-4a1c-8845-0b28fe6c81bb" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.744807] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1738c05b-4a1d-4a1c-8845-0b28fe6c81bb" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.745210] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.745210] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.745210] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.745399] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.745523] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.745574] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1738c05b-4a1d-4a1c-8845-0b28fe6c81bb',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.914754] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.914948] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.914987] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.915218] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.916292] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.916292] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 is going to be updated. [ 1138.944584] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.944736] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.944809] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.945031] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.945180] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.956252] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 in Status: IN_PROGRESS for 2s [ 1139.130915] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-397 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.131168] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-397" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.131300] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-397" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.131729] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-397" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.132156] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.132425] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.132577] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.132830] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.132989] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.133264] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1139.133390] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1139.133506] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1139.133622] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1139.133740] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1139.133855] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1139.134042] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1139.154045] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1139.154045] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1139.154249] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1139.154445] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-397" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.154816] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-fc39c5b2-b84e-46ad-a863-0d61fc056716 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.155012] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-fc39c5b2-b84e-46ad-a863-0d61fc056716" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.155168] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-fc39c5b2-b84e-46ad-a863-0d61fc056716" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.155661] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-fc39c5b2-b84e-46ad-a863-0d61fc056716" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.155891] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc39c5b2-b84e-46ad-a863-0d61fc056716',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.249891] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.250128] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.250189] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.250413] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.250500] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.250700] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.250796] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.250857] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.251020] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.251090] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.251190] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1738c05b-4a1d-4a1c-8845-0b28fe6c81bb already deleted. [ 1139.251278] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1738c05b-4a1d-4a1c-8845-0b28fe6c81bb" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.658413] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.658746] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.658784] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.659104] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.659263] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.659423] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port fc39c5b2-b84e-46ad-a863-0d61fc056716 not found, creating... [ 1139.659693] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.659859] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.660074] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.660363] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.660504] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.660800] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.660964] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.661101] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.661350] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.661447] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.661591] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: fc39c5b2-b84e-46ad-a863-0d61fc056716 is going to be created. [ 1139.681929] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.682224] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.682359] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.682633] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.682869] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.683146] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-fc39c5b2-b84e-46ad-a863-0d61fc056716" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.438204] env[62842]: INFO networking_nsxv3.common.synchronization [req-fa64119e-d370-4c4d-84f9-6bf1b24968fa req-9f0e5091-fb24-4f48-897c-c0c86e93ba62 service nova] Enqueued Resource ID: 1738c05b-4a1d-4a1c-8845-0b28fe6c81bb with Priority: HIGHEST for action security_group_rules [ 1140.438204] env[62842]: INFO networking_nsxv3.common.synchronization [req-fa64119e-d370-4c4d-84f9-6bf1b24968fa req-9f0e5091-fb24-4f48-897c-c0c86e93ba62 service nova] Enqueued Resource ID: 1738c05b-4a1d-4a1c-8845-0b28fe6c81bb with Priority: HIGHEST for action security_group_members [ 1140.438204] env[62842]: INFO networking_nsxv3.common.synchronization [req-fa64119e-d370-4c4d-84f9-6bf1b24968fa req-9f0e5091-fb24-4f48-897c-c0c86e93ba62 service nova] Enqueued Resource ID: fc39c5b2-b84e-46ad-a863-0d61fc056716 with Priority: HIGHEST for action port [ 1140.438323] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1738c05b-4a1d-4a1c-8845-0b28fe6c81bb with Priority: HIGHEST for action security_group_rules [ 1140.438376] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1738c05b-4a1d-4a1c-8845-0b28fe6c81bb with Priority: HIGHEST for action security_group_members [ 1140.438459] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc39c5b2-b84e-46ad-a863-0d61fc056716 with Priority: HIGHEST for action port [ 1140.439021] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1738c05b-4a1d-4a1c-8845-0b28fe6c81bb taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.439149] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1738c05b-4a1d-4a1c-8845-0b28fe6c81bb" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.439218] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1738c05b-4a1d-4a1c-8845-0b28fe6c81bb" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.439413] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1738c05b-4a1d-4a1c-8845-0b28fe6c81bb" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.439492] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1738c05b-4a1d-4a1c-8845-0b28fe6c81bb',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.440395] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-1738c05b-4a1d-4a1c-8845-0b28fe6c81bb taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.440395] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1738c05b-4a1d-4a1c-8845-0b28fe6c81bb" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.440473] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1738c05b-4a1d-4a1c-8845-0b28fe6c81bb" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.440598] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1738c05b-4a1d-4a1c-8845-0b28fe6c81bb" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.440741] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.440872] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.440916] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.441037] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.441169] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.441213] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1738c05b-4a1d-4a1c-8845-0b28fe6c81bb',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.442028] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc39c5b2-b84e-46ad-a863-0d61fc056716 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.442028] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc39c5b2-b84e-46ad-a863-0d61fc056716" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.442197] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc39c5b2-b84e-46ad-a863-0d61fc056716" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.442438] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc39c5b2-b84e-46ad-a863-0d61fc056716" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.442438] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc39c5b2-b84e-46ad-a863-0d61fc056716',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.944157] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-1738c05b-4a1d-4a1c-8845-0b28fe6c81bb taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.944566] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1738c05b-4a1d-4a1c-8845-0b28fe6c81bb" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.944566] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1738c05b-4a1d-4a1c-8845-0b28fe6c81bb',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.948283] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fc39c5b2-b84e-46ad-a863-0d61fc056716 with status ACTIVE [ 1140.948283] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.948283] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.948283] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.948283] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.948283] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.948283] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.948283] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.948283] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.948283] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.948283] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.948283] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.948283] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.948283] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.948283] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.948950] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.948950] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fc39c5b2-b84e-46ad-a863-0d61fc056716 is going to be updated. [ 1140.967438] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 in Status: SUCCESS [ 1140.967672] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.967945] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.968248] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.968502] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.968641] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.968716] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.968896] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.969012] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.969165] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.969303] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3e26630c-b3f7-4b48-9720-77b59135adf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.980107] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.980270] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.980377] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.980541] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.980699] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.980867] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc39c5b2-b84e-46ad-a863-0d61fc056716" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.045244] env[62842]: INFO networking_nsxv3.common.synchronization [req-d698cd1b-a4f7-4135-b44e-3d0dabdf1604 req-f9757c0c-32f2-40a4-955c-dfee91c16429 tempest-ServersTestJSON-1267616671 tempest-ServersTestJSON-1267616671-project-member] Enqueued Resource ID: 074be4e0-ffc9-4ec9-b29a-40406844218c with Priority: HIGHEST for action security_group_members [ 1141.046206] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 074be4e0-ffc9-4ec9-b29a-40406844218c with Priority: HIGHEST for action security_group_members [ 1141.046668] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-074be4e0-ffc9-4ec9-b29a-40406844218c taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.046857] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.046926] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.047237] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.047469] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.047596] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.047725] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.047940] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.048118] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.048165] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.435456] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-509 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.435605] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-509" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.435642] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-509" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.435933] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-509" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.436466] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.436725] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.436778] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.437067] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.437190] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.437521] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1141.437735] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1141.437940] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1141.438099] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1141.438229] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1141.438387] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1141.438481] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1141.450859] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1738c05b-4a1d-4a1c-8845-0b28fe6c81bb',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.460871] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1141.461063] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1141.461201] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1141.461393] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-509" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.461746] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-17488980-c477-41c9-86c4-b520e60bbc81 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.461972] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-17488980-c477-41c9-86c4-b520e60bbc81" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.462164] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-17488980-c477-41c9-86c4-b520e60bbc81" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.462558] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-17488980-c477-41c9-86c4-b520e60bbc81" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.462708] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17488980-c477-41c9-86c4-b520e60bbc81',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.471132] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e26630c-b3f7-4b48-9720-77b59135adf4 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.471302] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.471375] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.471624] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.471794] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.472282] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.472380] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.472588] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.472705] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.472815] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.473055] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e26630c-b3f7-4b48-9720-77b59135adf4 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.473227] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.473309] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.473463] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.473609] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.473768] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.473824] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.474018] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.474107] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.474194] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.474297] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3e26630c-b3f7-4b48-9720-77b59135adf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.550862] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.955039] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.955039] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.955039] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.955039] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.955039] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.955039] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1738c05b-4a1d-4a1c-8845-0b28fe6c81bb is going to be created. [ 1141.965725] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.965952] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.966100] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.966379] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.966539] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.966734] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 17488980-c477-41c9-86c4-b520e60bbc81 not found, creating... [ 1141.967011] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.967234] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.967377] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.967603] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.967744] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.968119] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.968304] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.968425] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.968636] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.968774] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.968915] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 17488980-c477-41c9-86c4-b520e60bbc81 is going to be created. [ 1141.976645] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3e26630c-b3f7-4b48-9720-77b59135adf4: rpc.has_security_group_logging(os_id): False [ 1141.980861] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.981125] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.981125] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.981245] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.981387] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.987431] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.987638] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.987706] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.987933] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.988274] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.988529] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-17488980-c477-41c9-86c4-b520e60bbc81" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.997167] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1738c05b-4a1d-4a1c-8845-0b28fe6c81bb in Status: UNINITIALIZED for 2s [ 1142.003629] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.003817] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.003817] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.004045] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.004140] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.004366] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.004488] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.004553] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.004704] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.004780] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.004962] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.005075] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.005140] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.005279] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.005355] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.005534] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.005627] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.005687] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.005824] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.005897] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.005979] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 is going to be updated. [ 1142.053178] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.068406] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.068612] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.068794] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.069108] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.069353] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.086800] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 in Status: IN_PROGRESS for 2s [ 1142.558328] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.558328] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.558328] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.558328] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.558328] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.558328] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 074be4e0-ffc9-4ec9-b29a-40406844218c is going to be updated. [ 1142.601140] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.601140] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.601140] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.601140] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.601140] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.610852] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 074be4e0-ffc9-4ec9-b29a-40406844218c in Status: IN_PROGRESS for 2s [ 1142.631023] env[62842]: INFO networking_nsxv3.common.synchronization [req-a0d7b0f9-0c3e-47af-b36d-78b047611f80 req-729e2f75-dd5e-4a79-a656-f764909bb14b tempest-InstanceActionsV221TestJSON-209202169 tempest-InstanceActionsV221TestJSON-209202169-project-member] Enqueued Resource ID: a9fd4555-77cd-4151-9f34-13bead661429 with Priority: HIGHEST for action security_group_members [ 1142.631023] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9fd4555-77cd-4151-9f34-13bead661429 with Priority: HIGHEST for action security_group_members [ 1142.631023] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9fd4555-77cd-4151-9f34-13bead661429 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.631023] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9fd4555-77cd-4151-9f34-13bead661429" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.631023] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9fd4555-77cd-4151-9f34-13bead661429" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.632067] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9fd4555-77cd-4151-9f34-13bead661429" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.634053] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.634053] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.634053] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.634053] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.634053] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.634053] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9fd4555-77cd-4151-9f34-13bead661429',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.761496] env[62842]: INFO networking_nsxv3.common.synchronization [req-d698cd1b-a4f7-4135-b44e-3d0dabdf1604 req-52488215-1782-491a-bcfe-e1187598f615 service nova] Enqueued Resource ID: 074be4e0-ffc9-4ec9-b29a-40406844218c with Priority: HIGHEST for action security_group_rules [ 1142.761496] env[62842]: INFO networking_nsxv3.common.synchronization [req-d698cd1b-a4f7-4135-b44e-3d0dabdf1604 req-52488215-1782-491a-bcfe-e1187598f615 service nova] Enqueued Resource ID: 074be4e0-ffc9-4ec9-b29a-40406844218c with Priority: HIGHEST for action security_group_members [ 1142.761496] env[62842]: INFO networking_nsxv3.common.synchronization [req-d698cd1b-a4f7-4135-b44e-3d0dabdf1604 req-52488215-1782-491a-bcfe-e1187598f615 service nova] Enqueued Resource ID: 17488980-c477-41c9-86c4-b520e60bbc81 with Priority: HIGHEST for action port [ 1142.761496] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 074be4e0-ffc9-4ec9-b29a-40406844218c with Priority: HIGHEST for action security_group_rules [ 1142.761496] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 074be4e0-ffc9-4ec9-b29a-40406844218c with Priority: HIGHEST for action security_group_members [ 1142.761496] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17488980-c477-41c9-86c4-b520e60bbc81 with Priority: HIGHEST for action port [ 1142.761496] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-074be4e0-ffc9-4ec9-b29a-40406844218c taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.762341] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.763891] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.763891] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.763891] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.764340] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-074be4e0-ffc9-4ec9-b29a-40406844218c taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.764503] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.764788] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-17488980-c477-41c9-86c4-b520e60bbc81 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.764971] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-17488980-c477-41c9-86c4-b520e60bbc81" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.765080] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-17488980-c477-41c9-86c4-b520e60bbc81" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.765314] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-17488980-c477-41c9-86c4-b520e60bbc81" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.765438] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17488980-c477-41c9-86c4-b520e60bbc81',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.138032] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.138032] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.138032] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.138032] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.138032] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.138032] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.138032] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.138032] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.138032] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.138032] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.138032] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9fd4555-77cd-4151-9f34-13bead661429 is going to be updated. [ 1143.171821] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.172403] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.172596] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.172902] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.173187] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.188024] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9fd4555-77cd-4151-9f34-13bead661429 in Status: IN_PROGRESS for 2s [ 1143.267887] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-074be4e0-ffc9-4ec9-b29a-40406844218c taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.268355] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.269030] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 17488980-c477-41c9-86c4-b520e60bbc81 with status ACTIVE [ 1143.269156] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.270480] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.270480] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.270480] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.270480] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.270480] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.270480] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.270480] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.270480] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.270480] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.271213] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.271213] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.271213] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.271213] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.271213] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.271213] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 17488980-c477-41c9-86c4-b520e60bbc81 is going to be updated. [ 1143.299403] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.300262] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.300262] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.300262] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.300262] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.300262] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-17488980-c477-41c9-86c4-b520e60bbc81" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.453545] env[62842]: INFO networking_nsxv3.common.synchronization [req-c6cb6c23-ed32-49b3-b1f1-dc8258dce7e1 req-04dd968b-62a6-46a4-ab1a-b095061e3633 tempest-ServerActionsTestJSON-670456711 tempest-ServerActionsTestJSON-670456711-project-member] Enqueued Resource ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 with Priority: HIGHEST for action security_group_members [ 1143.454151] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 with Priority: HIGHEST for action security_group_members [ 1143.454475] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a03224f-b75b-48a5-9e23-3ca50aabbb33 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.454621] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.454727] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.455317] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.455495] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.455596] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.455672] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.455810] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.455900] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.455990] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a03224f-b75b-48a5-9e23-3ca50aabbb33',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.889119] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-830 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.889344] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-830" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.889475] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-830" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.889758] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-830" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.890033] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.890202] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.890325] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.890547] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.890697] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.890908] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1143.891096] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1143.891226] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1143.891340] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1143.891456] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1143.891563] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1143.891703] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1143.913102] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1143.913303] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1143.913900] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1143.913900] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-830" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.913900] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-e9c2358d-9ca1-4a03-97dd-897df34d287f taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.914186] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-e9c2358d-9ca1-4a03-97dd-897df34d287f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.914227] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-e9c2358d-9ca1-4a03-97dd-897df34d287f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.914552] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-e9c2358d-9ca1-4a03-97dd-897df34d287f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.914710] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9c2358d-9ca1-4a03-97dd-897df34d287f',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.960291] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.960291] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.960452] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.960772] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.960914] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.961317] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.961499] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.961629] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.961858] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.962011] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.962319] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 is going to be updated. [ 1144.000522] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.000704] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.000704] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.000850] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.000978] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.015307] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 in Status: IN_PROGRESS for 2s [ 1144.017524] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1738c05b-4a1d-4a1c-8845-0b28fe6c81bb in Status: SUCCESS [ 1144.017524] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1738c05b-4a1d-4a1c-8845-0b28fe6c81bb" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.017524] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1738c05b-4a1d-4a1c-8845-0b28fe6c81bb" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.017524] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1738c05b-4a1d-4a1c-8845-0b28fe6c81bb" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.017819] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.017957] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.018091] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.018680] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.018680] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.018680] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1738c05b-4a1d-4a1c-8845-0b28fe6c81bb" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.018680] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1738c05b-4a1d-4a1c-8845-0b28fe6c81bb',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.104892] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 in Status: SUCCESS [ 1144.105189] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.417658] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.417969] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.417969] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.418423] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.418573] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.418802] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port e9c2358d-9ca1-4a03-97dd-897df34d287f not found, creating... [ 1144.419197] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.419473] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.419613] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.420236] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.420236] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.420498] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.420845] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.420975] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.421671] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.421671] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.422140] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: e9c2358d-9ca1-4a03-97dd-897df34d287f is going to be created. [ 1144.450469] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.450763] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.450902] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.451430] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.451430] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.452096] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-e9c2358d-9ca1-4a03-97dd-897df34d287f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.521324] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1738c05b-4a1d-4a1c-8845-0b28fe6c81bb',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.703981] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 074be4e0-ffc9-4ec9-b29a-40406844218c in Status: SUCCESS [ 1144.703981] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.703981] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.703981] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.703981] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.703981] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.703981] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.703981] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.703981] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.703981] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.023374] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1738c05b-4a1d-4a1c-8845-0b28fe6c81bb: rpc.has_security_group_logging(os_id): False [ 1145.041276] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.041436] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.042109] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.042109] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.042109] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.042109] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.042333] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.042333] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.042477] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.042559] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.042648] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1738c05b-4a1d-4a1c-8845-0b28fe6c81bb is going to be created. [ 1145.106268] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.106419] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.106491] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.106712] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.106891] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.118996] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1738c05b-4a1d-4a1c-8845-0b28fe6c81bb in Status: IN_PROGRESS for 2s [ 1145.203325] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9fd4555-77cd-4151-9f34-13bead661429 in Status: SUCCESS [ 1145.203325] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9fd4555-77cd-4151-9f34-13bead661429 deletion is rescheduled due to dependency. [ 1145.203325] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9fd4555-77cd-4151-9f34-13bead661429" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.219902] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.241707] env[62842]: INFO networking_nsxv3.common.synchronization [req-c6cb6c23-ed32-49b3-b1f1-dc8258dce7e1 req-5aed9b6d-d710-4487-b26d-a693f2d5aa61 service nova] Enqueued Resource ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 with Priority: HIGHEST for action security_group_rules [ 1145.241707] env[62842]: INFO networking_nsxv3.common.synchronization [req-c6cb6c23-ed32-49b3-b1f1-dc8258dce7e1 req-5aed9b6d-d710-4487-b26d-a693f2d5aa61 service nova] Enqueued Resource ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 with Priority: HIGHEST for action security_group_members [ 1145.241707] env[62842]: INFO networking_nsxv3.common.synchronization [req-c6cb6c23-ed32-49b3-b1f1-dc8258dce7e1 req-5aed9b6d-d710-4487-b26d-a693f2d5aa61 service nova] Enqueued Resource ID: e9c2358d-9ca1-4a03-97dd-897df34d287f with Priority: HIGHEST for action port [ 1145.241707] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 with Priority: HIGHEST for action security_group_rules [ 1145.243647] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 with Priority: HIGHEST for action security_group_members [ 1145.243912] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9c2358d-9ca1-4a03-97dd-897df34d287f with Priority: HIGHEST for action port [ 1145.246168] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a03224f-b75b-48a5-9e23-3ca50aabbb33 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.246447] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.246629] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.246932] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.247030] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a03224f-b75b-48a5-9e23-3ca50aabbb33',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.248603] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a03224f-b75b-48a5-9e23-3ca50aabbb33 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.248695] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.248897] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-e9c2358d-9ca1-4a03-97dd-897df34d287f taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.248998] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e9c2358d-9ca1-4a03-97dd-897df34d287f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.249125] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e9c2358d-9ca1-4a03-97dd-897df34d287f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.249253] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e9c2358d-9ca1-4a03-97dd-897df34d287f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.249308] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9c2358d-9ca1-4a03-97dd-897df34d287f',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.721817] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.752458] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e9c2358d-9ca1-4a03-97dd-897df34d287f with status ACTIVE [ 1145.752619] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.752749] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.752798] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.753082] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.753223] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.753434] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.753731] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.753731] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.753881] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.753978] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.754258] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.754319] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.754354] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.754727] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.754727] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.755531] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e9c2358d-9ca1-4a03-97dd-897df34d287f is going to be updated. [ 1145.756776] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a03224f-b75b-48a5-9e23-3ca50aabbb33 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.756887] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.786263] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.786506] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.786556] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.786890] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.787098] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.787310] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e9c2358d-9ca1-4a03-97dd-897df34d287f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.028857] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 in Status: SUCCESS [ 1146.029062] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 deletion is rescheduled due to dependency. [ 1146.029677] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.029677] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.029677] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.030228] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.030425] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.030425] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.030621] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.030705] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.030807] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a03224f-b75b-48a5-9e23-3ca50aabbb33',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.224651] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.224836] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.224927] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.225151] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.225220] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.225324] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 074be4e0-ffc9-4ec9-b29a-40406844218c is going to be updated. [ 1146.260973] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.261241] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.261241] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.261635] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.261888] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.274961] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 074be4e0-ffc9-4ec9-b29a-40406844218c in Status: IN_PROGRESS for 2s [ 1146.534562] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a03224f-b75b-48a5-9e23-3ca50aabbb33',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.039483] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a03224f-b75b-48a5-9e23-3ca50aabbb33',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.134415] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1738c05b-4a1d-4a1c-8845-0b28fe6c81bb in Status: SUCCESS [ 1147.134771] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1738c05b-4a1d-4a1c-8845-0b28fe6c81bb" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.542685] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.542907] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.542907] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.543181] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.543324] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.543454] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 is going to be updated. [ 1147.589622] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.589976] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.589976] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.590116] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.590300] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.603155] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 in Status: IN_PROGRESS for 2s [ 1148.160359] env[62842]: INFO networking_nsxv3.common.synchronization [req-fdd6113d-f4ac-4f85-ac6f-fe94627bb4af req-33d77d75-93f1-4448-8863-0b030cb7d71e tempest-ServerRescueNegativeTestJSON-1880350091 tempest-ServerRescueNegativeTestJSON-1880350091-project-member] Enqueued Resource ID: ea061614-3b2c-4a61-a74b-32a4b42f10a1 with Priority: HIGHEST for action security_group_members [ 1148.162552] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea061614-3b2c-4a61-a74b-32a4b42f10a1 with Priority: HIGHEST for action security_group_members [ 1148.162552] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea061614-3b2c-4a61-a74b-32a4b42f10a1 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.162552] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.162552] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.162552] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.162552] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.162552] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.162552] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.162552] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.162552] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.162552] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea061614-3b2c-4a61-a74b-32a4b42f10a1',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.285931] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 074be4e0-ffc9-4ec9-b29a-40406844218c in Status: SUCCESS [ 1148.286176] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.286349] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.286610] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.286813] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.286940] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.287014] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.287165] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.287249] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.287336] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.287430] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.664715] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.664715] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.664715] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.665017] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.707997] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.708427] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.708629] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.708749] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.709086] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.709244] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.709396] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea061614-3b2c-4a61-a74b-32a4b42f10a1 is going to be updated. [ 1148.737720] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.737938] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.738083] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.738419] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.738631] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.751301] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea061614-3b2c-4a61-a74b-32a4b42f10a1 in Status: IN_PROGRESS for 2s [ 1148.792272] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-074be4e0-ffc9-4ec9-b29a-40406844218c taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.792272] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.792272] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.792507] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.792632] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.792751] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.792817] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.792976] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.793081] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.793179] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.793369] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-074be4e0-ffc9-4ec9-b29a-40406844218c taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.793467] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.793528] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.793676] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.793822] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.793915] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.793977] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.794138] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.794221] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.794306] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.794400] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.927633] env[62842]: INFO networking_nsxv3.common.synchronization [req-fcc1add8-b5a4-4d81-833b-4aaecf75e365 req-f3f54f8b-d528-4a1e-ac8f-f184343f30dc tempest-AttachInterfacesTestJSON-2140085841 tempest-AttachInterfacesTestJSON-2140085841-project-member] Enqueued Resource ID: 32ffe6c8-3c43-4477-ba28-405c32ea0087 with Priority: HIGHEST for action security_group_members [ 1148.928199] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32ffe6c8-3c43-4477-ba28-405c32ea0087 with Priority: HIGHEST for action security_group_members [ 1148.928496] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-32ffe6c8-3c43-4477-ba28-405c32ea0087 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.928673] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32ffe6c8-3c43-4477-ba28-405c32ea0087" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.928731] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32ffe6c8-3c43-4477-ba28-405c32ea0087" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.928925] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32ffe6c8-3c43-4477-ba28-405c32ea0087" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.929094] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.929192] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.929260] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.929423] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.929507] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.929607] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32ffe6c8-3c43-4477-ba28-405c32ea0087',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.296795] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 074be4e0-ffc9-4ec9-b29a-40406844218c: rpc.has_security_group_logging(os_id): False [ 1149.323495] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.323682] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.323745] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.323928] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.324032] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.324536] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.324536] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.324536] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.324771] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.324771] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.324844] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.324926] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.324974] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.325132] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.325199] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.325380] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.325466] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.325527] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.325663] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.325739] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.325824] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 074be4e0-ffc9-4ec9-b29a-40406844218c is going to be updated. [ 1149.431542] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('32ffe6c8-3c43-4477-ba28-405c32ea0087',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.439294] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.439444] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.439497] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.439704] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.439856] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.455264] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 074be4e0-ffc9-4ec9-b29a-40406844218c in Status: IN_PROGRESS for 2s [ 1149.617048] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 in Status: SUCCESS [ 1149.617048] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.617048] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.617048] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.617048] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.617577] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.617577] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.617577] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.617577] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.617577] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.617577] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0a03224f-b75b-48a5-9e23-3ca50aabbb33',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.933812] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('32ffe6c8-3c43-4477-ba28-405c32ea0087',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.123094] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0a03224f-b75b-48a5-9e23-3ca50aabbb33',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.437610] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.437889] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.437889] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.438045] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.438144] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.438242] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32ffe6c8-3c43-4477-ba28-405c32ea0087 is going to be updated. [ 1150.468338] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.468338] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.468338] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.468338] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.468338] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.477702] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32ffe6c8-3c43-4477-ba28-405c32ea0087 in Status: IN_PROGRESS for 2s [ 1150.626800] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0a03224f-b75b-48a5-9e23-3ca50aabbb33: rpc.has_security_group_logging(os_id): False [ 1150.648746] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.648936] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.648936] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.649191] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.649291] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.649545] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.649659] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.649720] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.649850] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.649924] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.650126] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 is going to be updated. [ 1150.712630] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.712775] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.712859] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.713206] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.713286] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.727691] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 in Status: IN_PROGRESS for 2s [ 1150.763249] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea061614-3b2c-4a61-a74b-32a4b42f10a1 in Status: SUCCESS [ 1150.763249] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea061614-3b2c-4a61-a74b-32a4b42f10a1 deletion is rescheduled due to dependency. [ 1150.763249] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.476726] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 074be4e0-ffc9-4ec9-b29a-40406844218c in Status: SUCCESS [ 1151.477111] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.491175] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32ffe6c8-3c43-4477-ba28-405c32ea0087 in Status: SUCCESS [ 1152.491638] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32ffe6c8-3c43-4477-ba28-405c32ea0087" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.743516] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 in Status: SUCCESS [ 1152.743793] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.145423] env[62842]: INFO networking_nsxv3.common.synchronization [req-f32b2843-62b8-4c09-bfe0-48dcaa32ae57 req-215fb89d-9cb8-4a48-a443-ebd900502f65 tempest-ServerActionsTestOtherA-1611322165 tempest-ServerActionsTestOtherA-1611322165-project-member] Enqueued Resource ID: 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 with Priority: HIGHEST for action security_group_members [ 1153.145423] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 with Priority: HIGHEST for action security_group_members [ 1153.145423] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.145423] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.145423] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.145423] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.145423] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.145423] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.145423] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.145423] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.145423] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.145423] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.646517] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.646833] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.646833] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.646952] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.647058] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.647256] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.647356] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.647413] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.647565] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.647643] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.647733] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 is going to be updated. [ 1153.680556] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.680556] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.680864] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.680864] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.680998] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.692028] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 in Status: IN_PROGRESS for 2s [ 1154.508037] env[62842]: INFO networking_nsxv3.common.synchronization [req-593eeabb-0b29-41b6-acb3-ca24b1c9b45b req-7d977357-def5-403f-bb5f-15941aacb360 tempest-ServersTestJSON-1267616671 tempest-ServersTestJSON-1267616671-project-member] Enqueued Resource ID: 074be4e0-ffc9-4ec9-b29a-40406844218c with Priority: HIGHEST for action security_group_members [ 1154.509523] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 074be4e0-ffc9-4ec9-b29a-40406844218c with Priority: HIGHEST for action security_group_members [ 1154.509889] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-074be4e0-ffc9-4ec9-b29a-40406844218c taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.510029] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.510109] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.510431] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.510596] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.510695] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.510751] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.510925] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.510995] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.511150] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.722974] env[62842]: INFO networking_nsxv3.common.synchronization [req-efb2d6ec-4a7b-4375-9657-25442489f312 req-4228505c-aab7-473b-9f67-304eed7788ef tempest-ImagesTestJSON-1786483082 tempest-ImagesTestJSON-1786483082-project-member] Enqueued Resource ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 with Priority: HIGHEST for action security_group_members [ 1154.722974] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 with Priority: HIGHEST for action security_group_members [ 1154.722974] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e26630c-b3f7-4b48-9720-77b59135adf4 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.722974] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.722974] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.722974] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.722974] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.722974] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.722974] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.722974] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.722974] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.722974] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e26630c-b3f7-4b48-9720-77b59135adf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.013839] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.225058] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e26630c-b3f7-4b48-9720-77b59135adf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.516631] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.703214] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 in Status: SUCCESS [ 1155.703427] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 deletion is rescheduled due to dependency. [ 1155.703544] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.729249] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e26630c-b3f7-4b48-9720-77b59135adf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.021454] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.021652] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.021696] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.022125] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.022125] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.022125] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 074be4e0-ffc9-4ec9-b29a-40406844218c is going to be updated. [ 1156.050843] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.050992] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.051094] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.051275] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.051420] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.061529] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 074be4e0-ffc9-4ec9-b29a-40406844218c in Status: IN_PROGRESS for 2s [ 1156.150842] env[62842]: INFO networking_nsxv3.common.synchronization [req-8d4a96ce-5df0-483e-806d-3e9091958076 req-73250f73-e6f8-4278-a6f6-a81d61b72ff6 tempest-AttachInterfacesTestJSON-2140085841 tempest-AttachInterfacesTestJSON-2140085841-project-member] Enqueued Resource ID: 32ffe6c8-3c43-4477-ba28-405c32ea0087 with Priority: HIGHEST for action security_group_members [ 1156.151411] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32ffe6c8-3c43-4477-ba28-405c32ea0087 with Priority: HIGHEST for action security_group_members [ 1156.151718] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-32ffe6c8-3c43-4477-ba28-405c32ea0087 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.151840] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32ffe6c8-3c43-4477-ba28-405c32ea0087" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.151903] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32ffe6c8-3c43-4477-ba28-405c32ea0087" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.152117] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32ffe6c8-3c43-4477-ba28-405c32ea0087" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.152325] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.152428] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.152490] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.152641] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.152726] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.152818] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32ffe6c8-3c43-4477-ba28-405c32ea0087',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.232038] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.232212] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.232293] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.232571] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.232650] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.232681] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 is going to be updated. [ 1156.262531] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.262683] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.262752] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.262965] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.263405] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.272988] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 in Status: IN_PROGRESS for 2s [ 1156.655058] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.655058] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.655058] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.655294] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.655384] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.655583] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.655678] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.655738] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.655884] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.655959] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.656091] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32ffe6c8-3c43-4477-ba28-405c32ea0087 is going to be updated. [ 1156.686082] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.686243] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.686292] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.686506] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.686646] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.695800] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32ffe6c8-3c43-4477-ba28-405c32ea0087 in Status: IN_PROGRESS for 2s [ 1158.071199] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 074be4e0-ffc9-4ec9-b29a-40406844218c in Status: SUCCESS [ 1158.071577] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.282429] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 in Status: SUCCESS [ 1158.282678] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.707549] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32ffe6c8-3c43-4477-ba28-405c32ea0087 in Status: IN_PROGRESS for 4s [ 1160.719506] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32ffe6c8-3c43-4477-ba28-405c32ea0087 in Status: SUCCESS [ 1160.719783] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32ffe6c8-3c43-4477-ba28-405c32ea0087 deletion is rescheduled due to dependency. [ 1160.719860] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32ffe6c8-3c43-4477-ba28-405c32ea0087" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.152625] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1161.152625] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1162.772071] env[62842]: INFO networking_nsxv3.common.synchronization [None req-d10c0660-3bb6-41a2-a8f1-aeec1c4196c1 None None] Enqueued Resource ID: 2f0578f4-6246-475d-af64-8aa0954e9ac6 with Priority: HIGHEST for action port [ 1162.772426] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f0578f4-6246-475d-af64-8aa0954e9ac6 with Priority: HIGHEST for action port [ 1162.774066] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f0578f4-6246-475d-af64-8aa0954e9ac6 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.774066] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f0578f4-6246-475d-af64-8aa0954e9ac6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.774066] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f0578f4-6246-475d-af64-8aa0954e9ac6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.774066] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f0578f4-6246-475d-af64-8aa0954e9ac6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.774066] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f0578f4-6246-475d-af64-8aa0954e9ac6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.847232] env[62842]: INFO networking_nsxv3.common.synchronization [None req-e7af77c9-fd28-4b32-86e2-f40e96ec7487 tempest-AttachInterfacesTestJSON-2140085841 tempest-AttachInterfacesTestJSON-2140085841-project-member] Enqueued Resource ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 with Priority: HIGHEST for action security_group_members [ 1162.847775] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 with Priority: HIGHEST for action security_group_members [ 1162.848083] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.848226] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.848309] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.848585] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.848673] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.848774] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.848830] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.848971] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.849073] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.849374] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77637a7d-8eb8-4f0e-a5bd-9870e0d191c6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.275525] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2f0578f4-6246-475d-af64-8aa0954e9ac6 [ 1163.275794] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.277243] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.277243] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.277416] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.277416] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.277506] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2f0578f4-6246-475d-af64-8aa0954e9ac6 already deleted. [ 1163.277542] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f0578f4-6246-475d-af64-8aa0954e9ac6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.351715] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.351929] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.351929] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.352281] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.352478] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.352708] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.352816] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.352917] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.353099] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.354033] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.354033] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 is going to be updated. [ 1163.387612] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.387612] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.391121] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.391417] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.391578] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.402041] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 in Status: IN_PROGRESS for 2s [ 1163.484410] env[62842]: INFO networking_nsxv3.common.synchronization [req-d18ca30d-bb71-4e01-8963-2d750f0a329e req-f1d717ed-d8ac-4e59-b09c-d9614d5f54a8 tempest-ImagesTestJSON-1786483082 tempest-ImagesTestJSON-1786483082-project-member] Enqueued Resource ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 with Priority: HIGHEST for action security_group_members [ 1163.484998] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 with Priority: HIGHEST for action security_group_members [ 1163.485280] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e26630c-b3f7-4b48-9720-77b59135adf4 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.485429] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.485525] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.485657] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.485825] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.486168] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.486168] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.486168] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.486343] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.486343] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e26630c-b3f7-4b48-9720-77b59135adf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.994707] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.995211] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.995211] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.995211] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.995379] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.995455] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.995552] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.995606] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.995765] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.995841] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.995930] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 is going to be updated. [ 1164.027051] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.027222] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.027260] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.027615] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.027615] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.036271] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 in Status: IN_PROGRESS for 2s [ 1165.009482] env[62842]: INFO networking_nsxv3.common.synchronization [None req-6168cc72-eca2-4a4a-a57c-d8adec7e6eac None None] Enqueued Resource ID: 2088034c-6766-46e5-8d35-5379aeaa868a with Priority: HIGHEST for action port [ 1165.009776] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2088034c-6766-46e5-8d35-5379aeaa868a with Priority: HIGHEST for action port [ 1165.010368] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-2088034c-6766-46e5-8d35-5379aeaa868a taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.010487] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2088034c-6766-46e5-8d35-5379aeaa868a" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.010551] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2088034c-6766-46e5-8d35-5379aeaa868a" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.010827] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2088034c-6766-46e5-8d35-5379aeaa868a" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.011593] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2088034c-6766-46e5-8d35-5379aeaa868a',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.414377] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 in Status: SUCCESS [ 1165.414575] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 deletion is rescheduled due to dependency. [ 1165.414707] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.496932] env[62842]: INFO networking_nsxv3.common.synchronization [req-821b7f9f-0d54-42f1-a9d2-a5354f778409 req-359e2ccc-0d21-4517-9de5-f41835fe1156 tempest-ServersTestJSON-1267616671 tempest-ServersTestJSON-1267616671-project-member] Enqueued Resource ID: 074be4e0-ffc9-4ec9-b29a-40406844218c with Priority: HIGHEST for action security_group_members [ 1165.497526] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 074be4e0-ffc9-4ec9-b29a-40406844218c with Priority: HIGHEST for action security_group_members [ 1165.497853] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-074be4e0-ffc9-4ec9-b29a-40406844218c taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.498187] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.498286] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.498493] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.498647] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.498751] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.498811] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.498954] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.499053] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.499155] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.515586] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2088034c-6766-46e5-8d35-5379aeaa868a [ 1165.515701] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.515874] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.515967] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.516270] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.516438] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.516530] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2088034c-6766-46e5-8d35-5379aeaa868a already deleted. [ 1165.516691] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2088034c-6766-46e5-8d35-5379aeaa868a" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.884609] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-509 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.884851] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-509" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.884983] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-509" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.885278] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-509" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.885548] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.885710] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.885829] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.886058] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.886206] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.886439] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1165.886560] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1165.886673] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1165.886785] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1165.886966] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1165.887011] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1165.887153] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1165.912804] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1165.912992] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1165.913259] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1165.913326] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-509" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.913616] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-b34a0b1b-276e-4b74-a40b-82ea7580c05a taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.913791] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-b34a0b1b-276e-4b74-a40b-82ea7580c05a" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.913912] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-b34a0b1b-276e-4b74-a40b-82ea7580c05a" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.914278] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-b34a0b1b-276e-4b74-a40b-82ea7580c05a" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.914490] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b34a0b1b-276e-4b74-a40b-82ea7580c05a',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.001251] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.045605] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 in Status: SUCCESS [ 1166.046034] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 deletion is rescheduled due to dependency. [ 1166.046034] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.417263] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.417976] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.417976] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.417976] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.418259] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.418259] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port b34a0b1b-276e-4b74-a40b-82ea7580c05a not found, creating... [ 1166.418505] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.418669] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.418792] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.419022] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.419162] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.419450] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.419611] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.419731] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.419943] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.420133] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.420330] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: b34a0b1b-276e-4b74-a40b-82ea7580c05a is going to be created. [ 1166.440460] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.440671] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.440819] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.441081] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.441419] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.441677] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-b34a0b1b-276e-4b74-a40b-82ea7580c05a" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.503486] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.006534] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.006726] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.006778] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.006955] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.007060] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.007155] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 074be4e0-ffc9-4ec9-b29a-40406844218c is going to be updated. [ 1167.041912] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.042101] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.042149] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.042412] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.042593] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.052795] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 074be4e0-ffc9-4ec9-b29a-40406844218c in Status: IN_PROGRESS for 2s [ 1167.394906] env[62842]: INFO networking_nsxv3.common.synchronization [req-821b7f9f-0d54-42f1-a9d2-a5354f778409 req-243f0a7c-5955-4aad-afe9-49faa10ea0b6 service nova] Enqueued Resource ID: 074be4e0-ffc9-4ec9-b29a-40406844218c with Priority: HIGHEST for action security_group_rules [ 1167.395103] env[62842]: INFO networking_nsxv3.common.synchronization [req-821b7f9f-0d54-42f1-a9d2-a5354f778409 req-243f0a7c-5955-4aad-afe9-49faa10ea0b6 service nova] Enqueued Resource ID: 074be4e0-ffc9-4ec9-b29a-40406844218c with Priority: HIGHEST for action security_group_members [ 1167.395244] env[62842]: INFO networking_nsxv3.common.synchronization [req-821b7f9f-0d54-42f1-a9d2-a5354f778409 req-243f0a7c-5955-4aad-afe9-49faa10ea0b6 service nova] Enqueued Resource ID: b34a0b1b-276e-4b74-a40b-82ea7580c05a with Priority: HIGHEST for action port [ 1167.395463] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 074be4e0-ffc9-4ec9-b29a-40406844218c with Priority: HIGHEST for action security_group_rules [ 1167.395594] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 074be4e0-ffc9-4ec9-b29a-40406844218c with Priority: HIGHEST for action security_group_members [ 1167.395690] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b34a0b1b-276e-4b74-a40b-82ea7580c05a with Priority: HIGHEST for action port [ 1167.396262] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-074be4e0-ffc9-4ec9-b29a-40406844218c taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.396394] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.396479] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.396675] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.396754] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.397625] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-074be4e0-ffc9-4ec9-b29a-40406844218c taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.397724] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.397940] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-b34a0b1b-276e-4b74-a40b-82ea7580c05a taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.398015] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b34a0b1b-276e-4b74-a40b-82ea7580c05a" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.400385] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b34a0b1b-276e-4b74-a40b-82ea7580c05a" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.400609] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b34a0b1b-276e-4b74-a40b-82ea7580c05a" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.400698] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b34a0b1b-276e-4b74-a40b-82ea7580c05a',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.685679] env[62842]: INFO networking_nsxv3.common.synchronization [req-6ffac37d-08bf-441a-88f3-3234be567676 req-f7a116ed-9253-4f00-833b-84d74f1876b6 tempest-ImagesTestJSON-1786483082 tempest-ImagesTestJSON-1786483082-project-member] Enqueued Resource ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 with Priority: HIGHEST for action security_group_members [ 1167.686251] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 with Priority: HIGHEST for action security_group_members [ 1167.686550] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e26630c-b3f7-4b48-9720-77b59135adf4 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.686673] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.686732] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.686933] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.687303] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.687303] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.687303] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.687451] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.687486] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.687562] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e26630c-b3f7-4b48-9720-77b59135adf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.903957] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-074be4e0-ffc9-4ec9-b29a-40406844218c taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.903957] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.903957] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b34a0b1b-276e-4b74-a40b-82ea7580c05a with status ACTIVE [ 1167.904125] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.904125] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.904211] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.904391] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.904546] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.904692] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.904794] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.904855] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.905025] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.906305] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.906305] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.906305] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.906305] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.906305] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.906305] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.906305] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b34a0b1b-276e-4b74-a40b-82ea7580c05a is going to be updated. [ 1167.927454] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.927668] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.927668] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.927916] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.928084] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.928249] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b34a0b1b-276e-4b74-a40b-82ea7580c05a" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.053029] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-41 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.053463] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-41" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.053505] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-41" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.053796] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-41" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.055193] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.055193] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.055193] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.055193] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.055193] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.055421] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1168.055519] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1168.055632] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1168.055742] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1168.055857] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1168.055964] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1168.056113] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1168.081385] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1168.081603] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1168.082335] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1168.082335] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-41" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.082335] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-63613e58-6334-4615-b277-26c67c0fe4c5 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.082612] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-63613e58-6334-4615-b277-26c67c0fe4c5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.082612] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-63613e58-6334-4615-b277-26c67c0fe4c5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.082890] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-63613e58-6334-4615-b277-26c67c0fe4c5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.083043] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63613e58-6334-4615-b277-26c67c0fe4c5',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.189525] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.189818] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.189818] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.190106] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.190266] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.190501] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.190612] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.190682] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.190848] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.190929] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.191031] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 is going to be updated. [ 1168.218874] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.219145] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.219145] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.219296] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.219443] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.229116] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 in Status: IN_PROGRESS for 2s [ 1168.585973] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.585973] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.585973] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.586245] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.586245] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.586415] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 63613e58-6334-4615-b277-26c67c0fe4c5 not found, creating... [ 1168.586686] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.586846] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.586970] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.587222] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.587377] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.587714] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.587885] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.588015] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.588501] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.588501] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.588700] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 63613e58-6334-4615-b277-26c67c0fe4c5 is going to be created. [ 1168.611358] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.611633] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.611763] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.612055] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.612535] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.612968] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-63613e58-6334-4615-b277-26c67c0fe4c5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.064962] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 074be4e0-ffc9-4ec9-b29a-40406844218c in Status: SUCCESS [ 1169.065391] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.065391] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.065524] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.065716] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.065833] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.065896] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.066072] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.066171] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.066250] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.381043] env[62842]: INFO networking_nsxv3.common.synchronization [req-6ffac37d-08bf-441a-88f3-3234be567676 req-c9aa0758-efea-496d-bc00-ff252358abae service nova] Enqueued Resource ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 with Priority: HIGHEST for action security_group_rules [ 1169.381271] env[62842]: INFO networking_nsxv3.common.synchronization [req-6ffac37d-08bf-441a-88f3-3234be567676 req-c9aa0758-efea-496d-bc00-ff252358abae service nova] Enqueued Resource ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 with Priority: HIGHEST for action security_group_members [ 1169.381423] env[62842]: INFO networking_nsxv3.common.synchronization [req-6ffac37d-08bf-441a-88f3-3234be567676 req-c9aa0758-efea-496d-bc00-ff252358abae service nova] Enqueued Resource ID: 63613e58-6334-4615-b277-26c67c0fe4c5 with Priority: HIGHEST for action port [ 1169.381663] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 with Priority: HIGHEST for action security_group_rules [ 1169.381791] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 with Priority: HIGHEST for action security_group_members [ 1169.381886] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63613e58-6334-4615-b277-26c67c0fe4c5 with Priority: HIGHEST for action port [ 1169.382716] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e26630c-b3f7-4b48-9720-77b59135adf4 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.382716] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.382716] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.382927] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.383017] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e26630c-b3f7-4b48-9720-77b59135adf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.383900] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e26630c-b3f7-4b48-9720-77b59135adf4 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.383972] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.384377] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-63613e58-6334-4615-b277-26c67c0fe4c5 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.384377] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-63613e58-6334-4615-b277-26c67c0fe4c5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.384538] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-63613e58-6334-4615-b277-26c67c0fe4c5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.384627] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-63613e58-6334-4615-b277-26c67c0fe4c5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.384676] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63613e58-6334-4615-b277-26c67c0fe4c5',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.568875] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.886847] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e26630c-b3f7-4b48-9720-77b59135adf4 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.887080] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.887191] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 63613e58-6334-4615-b277-26c67c0fe4c5 with status ACTIVE [ 1169.887291] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.887357] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.887432] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.887642] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.887733] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.887901] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.887995] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.888070] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.888220] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.888297] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.888479] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.888578] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.888631] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.889419] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.889419] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.889419] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 63613e58-6334-4615-b277-26c67c0fe4c5 is going to be updated. [ 1169.909983] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.910143] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.910738] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.910738] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.910738] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.910738] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-63613e58-6334-4615-b277-26c67c0fe4c5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.071182] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.239647] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 in Status: SUCCESS [ 1170.239860] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 deletion is rescheduled due to dependency. [ 1170.239930] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.240116] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.240620] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.241529] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.241529] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.241529] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.241529] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.241529] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.241529] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e26630c-b3f7-4b48-9720-77b59135adf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.573247] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.573512] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.573619] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.573854] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.573951] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.574081] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 074be4e0-ffc9-4ec9-b29a-40406844218c is going to be updated. [ 1170.600695] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.600695] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.600695] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.600991] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.600991] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.609944] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 074be4e0-ffc9-4ec9-b29a-40406844218c in Status: IN_PROGRESS for 2s [ 1170.743660] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e26630c-b3f7-4b48-9720-77b59135adf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.246447] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e26630c-b3f7-4b48-9720-77b59135adf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.749481] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.749691] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.749691] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.749894] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.749983] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.750097] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 is going to be updated. [ 1171.779480] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.779687] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.779735] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.779930] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.780089] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.794104] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 in Status: IN_PROGRESS for 2s [ 1172.602401] env[62842]: INFO networking_nsxv3.common.synchronization [req-9c56dffc-af8a-45a2-bb4c-331b27d01a76 req-88938323-9b90-4993-91f8-b4d9238ff50f tempest-ServerGroupTestJSON-1779223489 tempest-ServerGroupTestJSON-1779223489-project-member] Enqueued Resource ID: 9fae61ec-a635-4e29-b840-9933a22bfbe3 with Priority: HIGHEST for action security_group_members [ 1172.603023] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fae61ec-a635-4e29-b840-9933a22bfbe3 with Priority: HIGHEST for action security_group_members [ 1172.603378] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fae61ec-a635-4e29-b840-9933a22bfbe3 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.604417] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fae61ec-a635-4e29-b840-9933a22bfbe3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.604417] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fae61ec-a635-4e29-b840-9933a22bfbe3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.604417] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fae61ec-a635-4e29-b840-9933a22bfbe3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.604417] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.604417] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.604417] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.604417] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.604417] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.604417] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9fae61ec-a635-4e29-b840-9933a22bfbe3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.620580] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 074be4e0-ffc9-4ec9-b29a-40406844218c in Status: SUCCESS [ 1172.620798] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.621234] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.621782] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.621782] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.621782] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.621782] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.622152] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.622152] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.622152] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.622152] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.882915] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-245 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.883136] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-245" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.883375] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-245" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.883810] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-245" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.884118] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.884298] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.884423] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.884673] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.884831] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.885066] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1172.885193] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1172.885309] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1172.885423] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1172.885538] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1172.885650] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1172.885790] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1172.907210] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1172.907403] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1172.907523] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1172.907709] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-245" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.908061] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-304c70ec-12aa-4a90-8a3e-b5ea2ca49ed5 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.908262] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-304c70ec-12aa-4a90-8a3e-b5ea2ca49ed5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.908480] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-304c70ec-12aa-4a90-8a3e-b5ea2ca49ed5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.908648] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-304c70ec-12aa-4a90-8a3e-b5ea2ca49ed5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.908797] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('304c70ec-12aa-4a90-8a3e-b5ea2ca49ed5',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.106270] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.106486] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.106486] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.106654] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.106777] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.106982] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.107096] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.107153] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.107308] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.107387] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.107471] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9fae61ec-a635-4e29-b840-9933a22bfbe3 already deleted. [ 1173.107549] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fae61ec-a635-4e29-b840-9933a22bfbe3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.127478] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-074be4e0-ffc9-4ec9-b29a-40406844218c taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.127601] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.127660] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.127826] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.127977] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.128088] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.128172] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.129143] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.129143] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.129143] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.129143] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-074be4e0-ffc9-4ec9-b29a-40406844218c taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.129143] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.129143] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.129143] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.129143] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.129143] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.129143] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.129896] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.129896] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.129896] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.129896] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.411202] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.411422] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.411475] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.411819] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.411981] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.412184] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 304c70ec-12aa-4a90-8a3e-b5ea2ca49ed5 not found, creating... [ 1173.412664] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.412863] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.412988] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.413275] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.413429] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.413817] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.414092] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.414302] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.414625] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.414808] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.414954] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 304c70ec-12aa-4a90-8a3e-b5ea2ca49ed5 is going to be created. [ 1173.438187] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.438409] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.438544] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.438935] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.439199] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.439436] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-304c70ec-12aa-4a90-8a3e-b5ea2ca49ed5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.632423] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 074be4e0-ffc9-4ec9-b29a-40406844218c: rpc.has_security_group_logging(os_id): False [ 1173.651942] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.652212] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.652212] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.652482] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.652580] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.652807] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.652938] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.652998] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.653415] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.653415] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.653520] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.653571] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.653603] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.654723] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.654723] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.654723] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.654723] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.654723] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.654723] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.654723] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.654723] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 074be4e0-ffc9-4ec9-b29a-40406844218c is going to be updated. [ 1173.722074] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.722425] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.722425] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.722643] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.722796] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.743995] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 074be4e0-ffc9-4ec9-b29a-40406844218c in Status: IN_PROGRESS for 2s [ 1173.810621] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 in Status: SUCCESS [ 1173.810846] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.811030] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.811354] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.811613] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.811707] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.811765] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.811886] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.811965] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.812066] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.812195] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3e26630c-b3f7-4b48-9720-77b59135adf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.126830] env[62842]: INFO networking_nsxv3.common.synchronization [req-9c56dffc-af8a-45a2-bb4c-331b27d01a76 req-aef4eb03-9854-405f-98a4-49f4c63fa3ed service nova] Enqueued Resource ID: 9fae61ec-a635-4e29-b840-9933a22bfbe3 with Priority: HIGHEST for action security_group_rules [ 1174.127031] env[62842]: INFO networking_nsxv3.common.synchronization [req-9c56dffc-af8a-45a2-bb4c-331b27d01a76 req-aef4eb03-9854-405f-98a4-49f4c63fa3ed service nova] Enqueued Resource ID: 9fae61ec-a635-4e29-b840-9933a22bfbe3 with Priority: HIGHEST for action security_group_members [ 1174.127173] env[62842]: INFO networking_nsxv3.common.synchronization [req-9c56dffc-af8a-45a2-bb4c-331b27d01a76 req-aef4eb03-9854-405f-98a4-49f4c63fa3ed service nova] Enqueued Resource ID: 304c70ec-12aa-4a90-8a3e-b5ea2ca49ed5 with Priority: HIGHEST for action port [ 1174.127415] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fae61ec-a635-4e29-b840-9933a22bfbe3 with Priority: HIGHEST for action security_group_rules [ 1174.127545] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fae61ec-a635-4e29-b840-9933a22bfbe3 with Priority: HIGHEST for action security_group_members [ 1174.127639] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 304c70ec-12aa-4a90-8a3e-b5ea2ca49ed5 with Priority: HIGHEST for action port [ 1174.128222] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9fae61ec-a635-4e29-b840-9933a22bfbe3 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.128366] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9fae61ec-a635-4e29-b840-9933a22bfbe3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.128405] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9fae61ec-a635-4e29-b840-9933a22bfbe3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.128662] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9fae61ec-a635-4e29-b840-9933a22bfbe3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.128742] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9fae61ec-a635-4e29-b840-9933a22bfbe3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.129877] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fae61ec-a635-4e29-b840-9933a22bfbe3 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.129971] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fae61ec-a635-4e29-b840-9933a22bfbe3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.130056] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fae61ec-a635-4e29-b840-9933a22bfbe3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.130237] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fae61ec-a635-4e29-b840-9933a22bfbe3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.130406] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.130477] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.130538] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.130706] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.130758] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.130846] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9fae61ec-a635-4e29-b840-9933a22bfbe3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.131587] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-304c70ec-12aa-4a90-8a3e-b5ea2ca49ed5 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.131768] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-304c70ec-12aa-4a90-8a3e-b5ea2ca49ed5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.131768] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-304c70ec-12aa-4a90-8a3e-b5ea2ca49ed5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.131944] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-304c70ec-12aa-4a90-8a3e-b5ea2ca49ed5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.131980] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('304c70ec-12aa-4a90-8a3e-b5ea2ca49ed5',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.314856] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e26630c-b3f7-4b48-9720-77b59135adf4 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.315060] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.315137] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.315384] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.315576] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.315701] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.315768] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.315941] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.316088] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.316217] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.316414] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e26630c-b3f7-4b48-9720-77b59135adf4 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.316571] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.316680] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.316879] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.317042] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.317140] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.317203] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.317513] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.317624] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.317711] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.317801] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3e26630c-b3f7-4b48-9720-77b59135adf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.633480] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fae61ec-a635-4e29-b840-9933a22bfbe3 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.633844] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fae61ec-a635-4e29-b840-9933a22bfbe3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.633844] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9fae61ec-a635-4e29-b840-9933a22bfbe3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.634810] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 304c70ec-12aa-4a90-8a3e-b5ea2ca49ed5 with status ACTIVE [ 1174.634906] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.635034] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.635091] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.635294] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.635376] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.635544] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.635634] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.635694] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.635875] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.635926] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.636093] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.636183] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.636241] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.636377] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.636447] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.636525] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 304c70ec-12aa-4a90-8a3e-b5ea2ca49ed5 is going to be updated. [ 1174.657205] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.657404] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.657404] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.657577] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.657718] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.657878] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-304c70ec-12aa-4a90-8a3e-b5ea2ca49ed5" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.820332] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3e26630c-b3f7-4b48-9720-77b59135adf4: rpc.has_security_group_logging(os_id): False [ 1174.839667] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.839862] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.839940] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.840221] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.840456] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.840648] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.840748] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.840829] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.841021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.841129] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.841369] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.841454] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.841534] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.841850] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.842059] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.842183] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.842373] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.842452] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.842617] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.842713] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.842880] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 is going to be updated. [ 1174.906197] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.906197] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.906197] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.906197] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.906197] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.920799] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 in Status: IN_PROGRESS for 2s [ 1175.138363] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9fae61ec-a635-4e29-b840-9933a22bfbe3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.641173] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.641641] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.641641] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.641641] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.641757] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.641788] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9fae61ec-a635-4e29-b840-9933a22bfbe3 is going to be created. [ 1175.666594] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.666823] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.666823] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.666995] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.667166] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.676466] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fae61ec-a635-4e29-b840-9933a22bfbe3 in Status: UNINITIALIZED for 2s [ 1175.758565] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 074be4e0-ffc9-4ec9-b29a-40406844218c in Status: SUCCESS [ 1175.758812] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.934927] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 in Status: SUCCESS [ 1176.935348] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.691388] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fae61ec-a635-4e29-b840-9933a22bfbe3 in Status: UNINITIALIZED for 4s [ 1179.128739] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1179.129172] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1179.703879] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fae61ec-a635-4e29-b840-9933a22bfbe3 in Status: SUCCESS [ 1179.705134] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fae61ec-a635-4e29-b840-9933a22bfbe3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.705134] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fae61ec-a635-4e29-b840-9933a22bfbe3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.705134] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fae61ec-a635-4e29-b840-9933a22bfbe3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.705134] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.705134] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.705134] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.705432] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.705432] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.705493] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fae61ec-a635-4e29-b840-9933a22bfbe3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.705589] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9fae61ec-a635-4e29-b840-9933a22bfbe3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.207877] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fae61ec-a635-4e29-b840-9933a22bfbe3 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.208318] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fae61ec-a635-4e29-b840-9933a22bfbe3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.208318] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fae61ec-a635-4e29-b840-9933a22bfbe3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.208404] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fae61ec-a635-4e29-b840-9933a22bfbe3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.208566] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.208828] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.208828] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.208944] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.208980] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.209077] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fae61ec-a635-4e29-b840-9933a22bfbe3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.209229] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fae61ec-a635-4e29-b840-9933a22bfbe3 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.209313] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fae61ec-a635-4e29-b840-9933a22bfbe3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.209373] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fae61ec-a635-4e29-b840-9933a22bfbe3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.209513] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fae61ec-a635-4e29-b840-9933a22bfbe3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.209648] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.209737] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.209797] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.209928] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.210008] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.210094] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fae61ec-a635-4e29-b840-9933a22bfbe3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.210191] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9fae61ec-a635-4e29-b840-9933a22bfbe3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.712639] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9fae61ec-a635-4e29-b840-9933a22bfbe3: rpc.has_security_group_logging(os_id): False [ 1180.732515] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.732719] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.732811] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.733041] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.733141] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.733372] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.733489] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.733581] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.733722] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.733814] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.734038] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.734132] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.734194] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.734353] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.734427] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.734608] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.734739] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.734801] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.734938] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.735017] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.735132] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9fae61ec-a635-4e29-b840-9933a22bfbe3 is going to be created. [ 1180.792847] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.793057] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.793057] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.793270] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.793501] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.807985] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9fae61ec-a635-4e29-b840-9933a22bfbe3 in Status: IN_PROGRESS for 2s [ 1182.150645] env[62842]: INFO networking_nsxv3.common.synchronization [req-2f7dc05b-22c9-4a7b-b82f-7b2f234595a3 req-e92555c0-9b15-4bf7-99de-8890490dd7fb tempest-ServersTestJSON-1267616671 tempest-ServersTestJSON-1267616671-project-member] Enqueued Resource ID: 074be4e0-ffc9-4ec9-b29a-40406844218c with Priority: HIGHEST for action security_group_members [ 1182.151206] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 074be4e0-ffc9-4ec9-b29a-40406844218c with Priority: HIGHEST for action security_group_members [ 1182.151505] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-074be4e0-ffc9-4ec9-b29a-40406844218c taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.151628] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.151690] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.151887] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.152047] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.152150] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.152224] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.152407] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.152499] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.152624] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.655062] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.825621] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9fae61ec-a635-4e29-b840-9933a22bfbe3 in Status: SUCCESS [ 1182.825944] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9fae61ec-a635-4e29-b840-9933a22bfbe3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.156777] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.659721] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.659893] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.659953] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.660304] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.660408] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.660514] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 074be4e0-ffc9-4ec9-b29a-40406844218c is going to be updated. [ 1183.688681] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.688887] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.688981] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.689185] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.689338] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.779337] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 074be4e0-ffc9-4ec9-b29a-40406844218c in Status: IN_PROGRESS for 2s [ 1184.159772] env[62842]: INFO networking_nsxv3.common.synchronization [req-2cfffb35-6773-40be-b1c8-89b6df8cf870 req-27a96cca-6268-453b-a365-def8065e7881 tempest-ServerGroupTestJSON-1779223489 tempest-ServerGroupTestJSON-1779223489-project-member] Enqueued Resource ID: 9fae61ec-a635-4e29-b840-9933a22bfbe3 with Priority: HIGHEST for action security_group_members [ 1184.159772] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fae61ec-a635-4e29-b840-9933a22bfbe3 with Priority: HIGHEST for action security_group_members [ 1184.160029] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-9fae61ec-a635-4e29-b840-9933a22bfbe3 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.161033] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9fae61ec-a635-4e29-b840-9933a22bfbe3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.161033] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9fae61ec-a635-4e29-b840-9933a22bfbe3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.161033] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9fae61ec-a635-4e29-b840-9933a22bfbe3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.161033] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.161033] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.161033] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.161499] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.161499] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.161499] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9fae61ec-a635-4e29-b840-9933a22bfbe3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.664064] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.664333] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.664333] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.664416] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.664698] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.664698] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.664884] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.664884] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.664994] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.665062] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.665150] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9fae61ec-a635-4e29-b840-9933a22bfbe3 is going to be updated. [ 1184.692247] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.692247] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.692465] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.692578] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.692717] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.703938] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fae61ec-a635-4e29-b840-9933a22bfbe3 in Status: IN_PROGRESS for 2s [ 1185.789797] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 074be4e0-ffc9-4ec9-b29a-40406844218c in Status: SUCCESS [ 1185.790211] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.714636] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fae61ec-a635-4e29-b840-9933a22bfbe3 in Status: IN_PROGRESS for 4s [ 1188.491286] env[62842]: INFO networking_nsxv3.common.synchronization [req-7657a347-8285-4ee9-837c-80e730cab9e1 req-58bd9e74-9d56-4416-8995-e35ea19db9ed tempest-ServersTestJSON-1267616671 tempest-ServersTestJSON-1267616671-project-member] Enqueued Resource ID: 074be4e0-ffc9-4ec9-b29a-40406844218c with Priority: HIGHEST for action security_group_members [ 1188.492988] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 074be4e0-ffc9-4ec9-b29a-40406844218c with Priority: HIGHEST for action security_group_members [ 1188.492988] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-074be4e0-ffc9-4ec9-b29a-40406844218c taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.492988] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.492988] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.492988] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.492988] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.492988] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.493945] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.493945] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.493945] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.493945] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.725984] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9fae61ec-a635-4e29-b840-9933a22bfbe3 in Status: SUCCESS [ 1188.725984] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9fae61ec-a635-4e29-b840-9933a22bfbe3 deletion is rescheduled due to dependency. [ 1188.725984] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9fae61ec-a635-4e29-b840-9933a22bfbe3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.996277] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.996475] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.996523] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.996735] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.996828] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.997051] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.997152] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.997225] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.997354] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.997442] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.997517] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 074be4e0-ffc9-4ec9-b29a-40406844218c is going to be updated. [ 1189.026094] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.026337] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.026474] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.026796] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.027050] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.036911] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 074be4e0-ffc9-4ec9-b29a-40406844218c in Status: IN_PROGRESS for 2s [ 1189.271068] env[62842]: INFO networking_nsxv3.common.synchronization [req-50447c83-d9bb-45f9-9f04-1dab7f261d13 req-a875d86a-8267-4910-b013-2f588cf73c35 tempest-ImagesTestJSON-1786483082 tempest-ImagesTestJSON-1786483082-project-member] Enqueued Resource ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 with Priority: HIGHEST for action security_group_members [ 1189.271068] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 with Priority: HIGHEST for action security_group_members [ 1189.271068] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e26630c-b3f7-4b48-9720-77b59135adf4 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.271068] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.271068] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.272306] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.272306] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.272306] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.272306] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.272306] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.272306] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.272306] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e26630c-b3f7-4b48-9720-77b59135adf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.774515] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.774861] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.774861] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.774944] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.775031] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.775219] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.775319] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.775381] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.775529] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.775603] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.775690] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 is going to be updated. [ 1189.801528] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.801661] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.801730] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.801924] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.802075] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.814319] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 in Status: IN_PROGRESS for 2s [ 1191.047996] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 074be4e0-ffc9-4ec9-b29a-40406844218c in Status: SUCCESS [ 1191.048313] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 074be4e0-ffc9-4ec9-b29a-40406844218c deletion is rescheduled due to dependency. [ 1191.048389] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.826054] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 in Status: SUCCESS [ 1191.826281] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 deletion is rescheduled due to dependency. [ 1191.826439] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.272016] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1194.272016] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1198.835049] env[62842]: INFO networking_nsxv3.common.synchronization [req-0b354a47-f79c-4fb5-8580-045fea8b22e9 req-249ff9c8-cab9-4e14-afcf-6c7299042ad3 tempest-ServerActionsV293TestJSON-861524001 tempest-ServerActionsV293TestJSON-861524001-project-member] Enqueued Resource ID: 1738c05b-4a1d-4a1c-8845-0b28fe6c81bb with Priority: HIGHEST for action security_group_members [ 1198.835049] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1738c05b-4a1d-4a1c-8845-0b28fe6c81bb with Priority: HIGHEST for action security_group_members [ 1198.835049] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-1738c05b-4a1d-4a1c-8845-0b28fe6c81bb taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.835049] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1738c05b-4a1d-4a1c-8845-0b28fe6c81bb" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.835049] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1738c05b-4a1d-4a1c-8845-0b28fe6c81bb" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.836022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1738c05b-4a1d-4a1c-8845-0b28fe6c81bb" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.836022] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.836022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.836022] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.836475] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.836872] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.836872] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1738c05b-4a1d-4a1c-8845-0b28fe6c81bb',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.340220] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.340220] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.340220] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.340220] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.340220] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.340220] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.340220] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.340220] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.340220] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.340220] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.340220] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1738c05b-4a1d-4a1c-8845-0b28fe6c81bb is going to be updated. [ 1199.393927] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.394173] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.394281] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.394545] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.394699] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.411530] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1738c05b-4a1d-4a1c-8845-0b28fe6c81bb in Status: IN_PROGRESS for 2s [ 1201.423591] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1738c05b-4a1d-4a1c-8845-0b28fe6c81bb in Status: SUCCESS [ 1201.423901] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1738c05b-4a1d-4a1c-8845-0b28fe6c81bb deletion is rescheduled due to dependency. [ 1201.423983] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1738c05b-4a1d-4a1c-8845-0b28fe6c81bb" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.834549] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1203.834831] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1208.483081] env[62842]: INFO networking_nsxv3.common.synchronization [req-69f70915-4540-497f-925c-a6985b382d1f req-37a10c33-13d0-4911-bd0f-5e39f86e722f tempest-ServerActionsTestJSON-670456711 tempest-ServerActionsTestJSON-670456711-project-member] Enqueued Resource ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 with Priority: HIGHEST for action security_group_members [ 1208.483657] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 with Priority: HIGHEST for action security_group_members [ 1208.483976] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a03224f-b75b-48a5-9e23-3ca50aabbb33 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.484906] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.484906] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.484906] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.484906] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.484906] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.485267] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.485267] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.485267] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.485403] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a03224f-b75b-48a5-9e23-3ca50aabbb33',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.988185] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.988486] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.988486] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.988640] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.988708] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.988918] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.989079] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.989079] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.989219] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.989291] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.989383] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 is going to be updated. [ 1209.020697] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.020925] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.020993] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.021246] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.021395] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.030152] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 in Status: IN_PROGRESS for 2s [ 1211.042126] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 in Status: SUCCESS [ 1211.042532] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 deletion is rescheduled due to dependency. [ 1211.042532] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.484392] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1213.484722] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1216.752138] env[62842]: INFO networking_nsxv3.common.synchronization [None req-aac569b2-73e9-4fad-b03a-892f098a0756 None None] Enqueued Resource ID: 96b4df9c-aa75-4783-9a00-fd17421ff906 with Priority: HIGHEST for action port [ 1216.752432] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96b4df9c-aa75-4783-9a00-fd17421ff906 with Priority: HIGHEST for action port [ 1216.753166] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-96b4df9c-aa75-4783-9a00-fd17421ff906 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.753316] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96b4df9c-aa75-4783-9a00-fd17421ff906" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.753488] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96b4df9c-aa75-4783-9a00-fd17421ff906" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.753920] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96b4df9c-aa75-4783-9a00-fd17421ff906" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.754639] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96b4df9c-aa75-4783-9a00-fd17421ff906',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.256225] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 96b4df9c-aa75-4783-9a00-fd17421ff906 [ 1217.256531] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.256707] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.256805] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.257082] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.257203] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.257330] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:96b4df9c-aa75-4783-9a00-fd17421ff906 already deleted. [ 1217.257442] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96b4df9c-aa75-4783-9a00-fd17421ff906" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.328461] env[62842]: INFO networking_nsxv3.common.synchronization [None req-a559dad1-3c3d-4bf2-829d-f30de5cafc5e tempest-ServerActionsTestOtherB-1524579062 tempest-ServerActionsTestOtherB-1524579062-project-member] Enqueued Resource ID: 513f9fc9-fb62-455e-82a3-541765c9b912 with Priority: HIGHEST for action security_group_rules [ 1217.329115] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 513f9fc9-fb62-455e-82a3-541765c9b912 with Priority: HIGHEST for action security_group_rules [ 1217.329452] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-513f9fc9-fb62-455e-82a3-541765c9b912 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.329575] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.329642] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.329896] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.329980] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('513f9fc9-fb62-455e-82a3-541765c9b912',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.410227] env[62842]: INFO networking_nsxv3.common.synchronization [None req-a27c5ad0-a8d1-4ac6-8b8e-8d37106d932b tempest-ServerActionsTestOtherB-1524579062 tempest-ServerActionsTestOtherB-1524579062-project-member] Enqueued Resource ID: 513f9fc9-fb62-455e-82a3-541765c9b912 with Priority: HIGHEST for action security_group_rules [ 1217.410701] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 513f9fc9-fb62-455e-82a3-541765c9b912 with Priority: HIGHEST for action security_group_rules [ 1217.411051] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-513f9fc9-fb62-455e-82a3-541765c9b912 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.411166] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.851816] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.852188] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.852188] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.852311] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.852384] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.852482] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 513f9fc9-fb62-455e-82a3-541765c9b912 already deleted. [ 1217.852593] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.852755] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.852907] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.852989] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('513f9fc9-fb62-455e-82a3-541765c9b912',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.374299] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.374496] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.374542] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.374932] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.374932] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.374932] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 513f9fc9-fb62-455e-82a3-541765c9b912 already deleted. [ 1218.375170] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.065142] env[62842]: INFO networking_nsxv3.common.synchronization [None req-91a67e6b-1c31-4da2-a11b-e6cc2126d90f None None] Enqueued Resource ID: 944b8d81-fb95-48d1-86ef-bcd93871793d with Priority: HIGHEST for action port [ 1219.065722] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 944b8d81-fb95-48d1-86ef-bcd93871793d with Priority: HIGHEST for action port [ 1219.066158] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-944b8d81-fb95-48d1-86ef-bcd93871793d taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.066353] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-944b8d81-fb95-48d1-86ef-bcd93871793d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.066442] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-944b8d81-fb95-48d1-86ef-bcd93871793d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.066746] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-944b8d81-fb95-48d1-86ef-bcd93871793d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.066902] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('944b8d81-fb95-48d1-86ef-bcd93871793d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.569496] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 944b8d81-fb95-48d1-86ef-bcd93871793d [ 1219.569700] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.569839] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.569903] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.570158] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.570257] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.570355] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:944b8d81-fb95-48d1-86ef-bcd93871793d already deleted. [ 1219.570455] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-944b8d81-fb95-48d1-86ef-bcd93871793d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.081921] env[62842]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1220.082254] env[62842]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] NSXv3 Agent Agent loop - iteration:3 started [ 1224.066687] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1224.067090] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1224.751851] env[62842]: INFO networking_nsxv3.common.synchronization [req-07ce1ba2-6ea2-4006-a3b7-5e9ea01a390e req-ac406ee9-9cc8-48d3-9fff-6e576bbb6d60 tempest-ServerActionsTestOtherB-1524579062 tempest-ServerActionsTestOtherB-1524579062-project-member] Enqueued Resource ID: 513f9fc9-fb62-455e-82a3-541765c9b912 with Priority: HIGHEST for action security_group_members [ 1224.752397] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 513f9fc9-fb62-455e-82a3-541765c9b912 with Priority: HIGHEST for action security_group_members [ 1224.752834] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-513f9fc9-fb62-455e-82a3-541765c9b912 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.752981] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.753125] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.753405] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.753596] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.753809] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.753909] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.754137] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.754225] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.754344] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('513f9fc9-fb62-455e-82a3-541765c9b912',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.041066] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-246 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.041275] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-246" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.041404] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-246" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.041755] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-246" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.042031] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.042195] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.042319] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.042533] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.042758] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.042984] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1225.043117] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1225.043232] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1225.043344] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1225.043456] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1225.043564] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1225.043705] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1225.064366] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1225.064529] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1225.064635] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1225.064820] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-246" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.065196] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-4b57ba69-5dfc-4f9b-b663-ca94bd73b21c taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.065380] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-4b57ba69-5dfc-4f9b-b663-ca94bd73b21c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.065505] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-4b57ba69-5dfc-4f9b-b663-ca94bd73b21c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.065822] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-4b57ba69-5dfc-4f9b-b663-ca94bd73b21c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.065966] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b57ba69-5dfc-4f9b-b663-ca94bd73b21c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.257768] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.258203] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.258203] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.258288] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.258380] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.258589] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.258695] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.258760] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.258920] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.258997] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.259097] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 513f9fc9-fb62-455e-82a3-541765c9b912 already deleted. [ 1225.259176] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.568451] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.568629] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.568758] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.569117] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.569211] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.569407] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 4b57ba69-5dfc-4f9b-b663-ca94bd73b21c not found, creating... [ 1225.569628] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.569821] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.569951] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.570190] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.570332] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.570631] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.570954] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.571031] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.571213] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.571345] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.571488] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 4b57ba69-5dfc-4f9b-b663-ca94bd73b21c is going to be created. [ 1225.595555] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.595784] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.595995] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.596297] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.596532] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.596758] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-4b57ba69-5dfc-4f9b-b663-ca94bd73b21c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.266585] env[62842]: INFO networking_nsxv3.common.synchronization [req-07ce1ba2-6ea2-4006-a3b7-5e9ea01a390e req-c3aa93b7-10da-4298-93a8-1c64ecf2435e service nova] Enqueued Resource ID: 513f9fc9-fb62-455e-82a3-541765c9b912 with Priority: HIGHEST for action security_group_rules [ 1226.266841] env[62842]: INFO networking_nsxv3.common.synchronization [req-07ce1ba2-6ea2-4006-a3b7-5e9ea01a390e req-c3aa93b7-10da-4298-93a8-1c64ecf2435e service nova] Enqueued Resource ID: 513f9fc9-fb62-455e-82a3-541765c9b912 with Priority: HIGHEST for action security_group_members [ 1226.266841] env[62842]: INFO networking_nsxv3.common.synchronization [req-07ce1ba2-6ea2-4006-a3b7-5e9ea01a390e req-c3aa93b7-10da-4298-93a8-1c64ecf2435e service nova] Enqueued Resource ID: 4b57ba69-5dfc-4f9b-b663-ca94bd73b21c with Priority: HIGHEST for action port [ 1226.267146] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 513f9fc9-fb62-455e-82a3-541765c9b912 with Priority: HIGHEST for action security_group_rules [ 1226.267146] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 513f9fc9-fb62-455e-82a3-541765c9b912 with Priority: HIGHEST for action security_group_members [ 1226.267290] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b57ba69-5dfc-4f9b-b663-ca94bd73b21c with Priority: HIGHEST for action port [ 1226.268239] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-513f9fc9-fb62-455e-82a3-541765c9b912 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.268398] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.268457] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.268610] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.268692] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('513f9fc9-fb62-455e-82a3-541765c9b912',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.269485] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-513f9fc9-fb62-455e-82a3-541765c9b912 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.269595] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.269662] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.269821] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.269965] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.270069] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.270126] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.270258] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.270340] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.270428] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('513f9fc9-fb62-455e-82a3-541765c9b912',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.271155] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b57ba69-5dfc-4f9b-b663-ca94bd73b21c taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.271286] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b57ba69-5dfc-4f9b-b663-ca94bd73b21c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.271342] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b57ba69-5dfc-4f9b-b663-ca94bd73b21c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.272098] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b57ba69-5dfc-4f9b-b663-ca94bd73b21c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.272098] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b57ba69-5dfc-4f9b-b663-ca94bd73b21c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.773590] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-513f9fc9-fb62-455e-82a3-541765c9b912 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.773742] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.773969] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('513f9fc9-fb62-455e-82a3-541765c9b912',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.774957] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4b57ba69-5dfc-4f9b-b663-ca94bd73b21c with status ACTIVE [ 1226.775196] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.775330] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.775413] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.775588] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.775675] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.775851] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.776036] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.776036] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.776175] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.776243] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.776428] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.776519] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.776575] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.776715] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.776849] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.776904] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4b57ba69-5dfc-4f9b-b663-ca94bd73b21c is going to be updated. [ 1226.798903] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.799169] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.799169] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.799305] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.799497] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.799593] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b57ba69-5dfc-4f9b-b663-ca94bd73b21c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.279948] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('513f9fc9-fb62-455e-82a3-541765c9b912',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.783976] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.783976] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.783976] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.783976] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.783976] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.783976] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 513f9fc9-fb62-455e-82a3-541765c9b912 is going to be created. [ 1227.811621] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.811621] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.811621] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.811621] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.811621] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.819633] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 513f9fc9-fb62-455e-82a3-541765c9b912 in Status: UNINITIALIZED for 2s [ 1228.141342] env[62842]: INFO networking_nsxv3.common.synchronization [None req-9150d7da-4fd1-437b-b917-7bc483a5de0e None None] Enqueued Resource ID: 3f6d155b-771c-452a-8932-a36127ccd95c with Priority: HIGHEST for action port [ 1228.141642] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f6d155b-771c-452a-8932-a36127ccd95c with Priority: HIGHEST for action port [ 1228.142227] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-3f6d155b-771c-452a-8932-a36127ccd95c taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.142401] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3f6d155b-771c-452a-8932-a36127ccd95c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.142401] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3f6d155b-771c-452a-8932-a36127ccd95c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.143356] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3f6d155b-771c-452a-8932-a36127ccd95c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.143356] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f6d155b-771c-452a-8932-a36127ccd95c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.647384] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3f6d155b-771c-452a-8932-a36127ccd95c [ 1228.647648] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.647744] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.647813] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.648081] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.648139] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.648252] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3f6d155b-771c-452a-8932-a36127ccd95c already deleted. [ 1228.648300] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3f6d155b-771c-452a-8932-a36127ccd95c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.831455] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 513f9fc9-fb62-455e-82a3-541765c9b912 in Status: SUCCESS [ 1229.831817] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.831870] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.832079] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.832274] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.832389] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.832455] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.832604] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.832730] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.832823] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.832913] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('513f9fc9-fb62-455e-82a3-541765c9b912',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.236730] env[62842]: INFO networking_nsxv3.common.synchronization [None req-9c045994-3913-479a-9fa9-d01a91f37729 None None] Enqueued Resource ID: 68db3a42-bf1e-4a73-965f-687ceaa50e26 with Priority: HIGHEST for action port [ 1230.236992] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68db3a42-bf1e-4a73-965f-687ceaa50e26 with Priority: HIGHEST for action port [ 1230.237565] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-68db3a42-bf1e-4a73-965f-687ceaa50e26 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.237706] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68db3a42-bf1e-4a73-965f-687ceaa50e26" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.237790] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68db3a42-bf1e-4a73-965f-687ceaa50e26" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.238062] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68db3a42-bf1e-4a73-965f-687ceaa50e26" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.238144] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68db3a42-bf1e-4a73-965f-687ceaa50e26',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.335417] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('513f9fc9-fb62-455e-82a3-541765c9b912',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.740542] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 68db3a42-bf1e-4a73-965f-687ceaa50e26 [ 1230.740814] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.740966] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.741047] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.741259] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.741347] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.741440] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:68db3a42-bf1e-4a73-965f-687ceaa50e26 already deleted. [ 1230.741596] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68db3a42-bf1e-4a73-965f-687ceaa50e26" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.837455] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 513f9fc9-fb62-455e-82a3-541765c9b912: rpc.has_security_group_logging(os_id): False [ 1230.856053] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.856224] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.856269] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.856472] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.856561] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.856793] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.856894] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.856952] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.857113] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.857187] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.857274] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 513f9fc9-fb62-455e-82a3-541765c9b912 is going to be created. [ 1230.919683] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.919890] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.919890] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.920569] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.921028] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.931741] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 513f9fc9-fb62-455e-82a3-541765c9b912 in Status: IN_PROGRESS for 2s [ 1232.944938] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 513f9fc9-fb62-455e-82a3-541765c9b912 in Status: SUCCESS [ 1232.945358] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.158698] env[62842]: INFO networking_nsxv3.common.synchronization [req-af5e559c-3b77-4b27-9bf8-96d833209acc req-4a00c360-f620-4903-9c44-288a99184480 tempest-ServersNegativeTestJSON-1512249164 tempest-ServersNegativeTestJSON-1512249164-project-member] Enqueued Resource ID: 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 with Priority: HIGHEST for action security_group_members [ 1234.158698] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 with Priority: HIGHEST for action security_group_members [ 1234.158698] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.158698] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.159161] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.167471] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.167656] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.167779] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.167851] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.168017] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.168109] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.168206] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.436028] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-128 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.436204] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-128" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.436297] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-128" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.436664] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-128" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.436953] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.437283] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.437446] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.437695] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.437868] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.438107] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1234.438230] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1234.438347] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1234.438461] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1234.438577] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1234.438694] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1234.438836] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1234.464120] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1234.464304] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1234.464447] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1234.464633] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-128" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.464966] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-295ad5a5-9d01-4023-89e9-d3f3e7dae4be taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.465206] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-295ad5a5-9d01-4023-89e9-d3f3e7dae4be" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.465333] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-295ad5a5-9d01-4023-89e9-d3f3e7dae4be" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.465670] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-295ad5a5-9d01-4023-89e9-d3f3e7dae4be" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.465812] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('295ad5a5-9d01-4023-89e9-d3f3e7dae4be',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.670854] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.671058] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.671108] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.671326] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.671418] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.671613] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.671709] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.671814] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.671948] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.672045] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.672130] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 already deleted. [ 1234.672209] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.968778] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.968778] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.968778] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.969077] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.969160] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.969326] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 295ad5a5-9d01-4023-89e9-d3f3e7dae4be not found, creating... [ 1234.969647] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.969817] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.969939] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.970179] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.970330] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.970600] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.970766] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.970917] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.971410] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.971577] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.971724] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 295ad5a5-9d01-4023-89e9-d3f3e7dae4be is going to be created. [ 1234.992491] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.992734] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.992835] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.993127] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.993423] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.993686] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-295ad5a5-9d01-4023-89e9-d3f3e7dae4be" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.697813] env[62842]: INFO networking_nsxv3.common.synchronization [req-af5e559c-3b77-4b27-9bf8-96d833209acc req-970f3811-53e0-4620-9ac7-c0cf2cbfce35 service nova] Enqueued Resource ID: 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 with Priority: HIGHEST for action security_group_rules [ 1235.698107] env[62842]: INFO networking_nsxv3.common.synchronization [req-af5e559c-3b77-4b27-9bf8-96d833209acc req-970f3811-53e0-4620-9ac7-c0cf2cbfce35 service nova] Enqueued Resource ID: 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 with Priority: HIGHEST for action security_group_members [ 1235.698260] env[62842]: INFO networking_nsxv3.common.synchronization [req-af5e559c-3b77-4b27-9bf8-96d833209acc req-970f3811-53e0-4620-9ac7-c0cf2cbfce35 service nova] Enqueued Resource ID: 295ad5a5-9d01-4023-89e9-d3f3e7dae4be with Priority: HIGHEST for action port [ 1235.698502] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 with Priority: HIGHEST for action security_group_rules [ 1235.698635] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 with Priority: HIGHEST for action security_group_members [ 1235.698764] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 295ad5a5-9d01-4023-89e9-d3f3e7dae4be with Priority: HIGHEST for action port [ 1235.699439] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.700113] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.700215] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.700552] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.700728] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.701690] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.701844] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.701947] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.702173] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.702378] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.702544] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.702625] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.702832] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.702958] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.706017] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.706017] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-295ad5a5-9d01-4023-89e9-d3f3e7dae4be taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.706017] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-295ad5a5-9d01-4023-89e9-d3f3e7dae4be" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.706017] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-295ad5a5-9d01-4023-89e9-d3f3e7dae4be" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.706017] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-295ad5a5-9d01-4023-89e9-d3f3e7dae4be" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.706017] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('295ad5a5-9d01-4023-89e9-d3f3e7dae4be',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.205863] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.206128] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.208470] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 295ad5a5-9d01-4023-89e9-d3f3e7dae4be with status ACTIVE [ 1236.208810] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.208965] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.208965] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.209216] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.209323] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.209498] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.209617] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.209684] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.210137] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.210137] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.210137] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.210352] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.210352] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.210422] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.210508] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.210608] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 295ad5a5-9d01-4023-89e9-d3f3e7dae4be is going to be updated. [ 1236.211781] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.233142] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.233311] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.233357] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.233544] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.233681] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.233897] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-295ad5a5-9d01-4023-89e9-d3f3e7dae4be" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.714978] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.217070] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.217320] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.217320] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.217456] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.217547] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.217647] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 is going to be created. [ 1237.241317] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.241555] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.241555] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.241719] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.241913] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.254910] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 in Status: UNINITIALIZED for 2s [ 1239.267137] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 in Status: SUCCESS [ 1239.267518] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.267518] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.267681] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.267867] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.267987] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.268079] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.268261] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.268345] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.268430] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.268521] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.771116] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.771349] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.771349] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.771537] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.771715] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.771813] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.771884] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.772035] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.772130] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.772211] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.772358] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.772449] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.772506] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.772653] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.772839] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.772916] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.772987] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.773142] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.773295] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.773295] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.773441] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.275518] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4: rpc.has_security_group_logging(os_id): False [ 1240.295930] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.296219] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.296219] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.296437] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.296554] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.296753] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.296869] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.296933] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.297155] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.297317] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.297459] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.297565] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.297626] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.297768] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.297846] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.298105] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.298207] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.298264] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.298405] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.298504] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.298615] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 is going to be created. [ 1240.364009] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.364265] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.364265] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.364488] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.364681] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.377481] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 in Status: IN_PROGRESS for 2s [ 1240.699516] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1240.699778] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1242.034511] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.034871] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.034871] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.034941] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.035050] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.393523] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 in Status: SUCCESS [ 1242.393702] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.539899] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.043023] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.545528] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1243.545757] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1244.310458] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.310753] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.310753] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.310988] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.324097] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1244.324974] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.325814] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1244.363474] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.363619] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.363674] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.363920] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.376695] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.377546] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1244.377648] env[62842]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=62842) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1244.377708] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1244.416504] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.416683] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.416683] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.416880] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.418220] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.418396] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1244.526602] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.526816] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.526816] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.527021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.527345] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.527624] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1244.638127] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.638368] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.638368] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.638560] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.638859] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.639195] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:45. [ 1244.639290] env[62842]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'ae20759e-0e4f-4e29-8897-7eb813e03b32', '15e06d0a-ad75-4e9d-b1a6-db54b2f524a4', '77637a7d-8eb8-4f0e-a5bd-9870e0d191c6', '0a03224f-b75b-48a5-9e23-3ca50aabbb33', 'c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311', '5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4', 'a9fd4555-77cd-4151-9f34-13bead661429', 'c184a589-476a-49bd-9984-d339a77ec8f3', '1738c05b-4a1d-4a1c-8845-0b28fe6c81bb', '1744456a-cfb4-4022-aed6-d7e18e95179b', '5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393', '3e26630c-b3f7-4b48-9720-77b59135adf4', '518e027d-4d1d-4cf5-a557-35f3eb956cd6', '35146777-fd28-4ac7-b454-f7dd3fbb5846', '29a28398-6e5b-4a4f-81e9-a2f458468c19', 'a14df1d2-b3a6-4075-b15b-967892c37b7e', 'c0ccbbde-9e94-45de-b00c-8f135b84465d', 'ea061614-3b2c-4a61-a74b-32a4b42f10a1', '0d049bd9-2d2b-49fc-98b0-e67bd0e7171b', '331dd47d-e3b4-4338-b588-cd456a9aa5f7', 'bc98288b-6b97-448c-a5b8-54058cb0d341', '2d753783-8988-4639-a0fc-596bf03e413b', 'c59f85b7-500a-400b-bef3-55b5e589248f', '72454528-d410-48ed-92f0-27b44c9abb61', '3a595937-aa58-40f8-a3cf-b57a814011e8', '017b2ee9-30e5-4870-86c3-53c03de20d66', '102e4bfe-92ec-41e7-859f-253e7a405698', '16baecd6-bda3-40e1-98ef-4e238a3fc354', '9fae61ec-a635-4e29-b840-9933a22bfbe3', '074be4e0-ffc9-4ec9-b29a-40406844218c', 'd014d213-d805-403a-bcc9-8c66da8eefa2', '513f9fc9-fb62-455e-82a3-541765c9b912', '1648554a-7f11-49bf-b9b2-6edf888e2ce9', '1669144b-ae4c-489e-95db-13be5c3bfb22', 'e509406e-18a0-4842-8350-5830bdc3ec79', '534d1af9-5f3d-417d-8cb4-3116f2425761', '789b6627-9a06-47bb-b607-d6625f262f66', 'e7acb0f4-6157-4a0c-977e-ee6a2808aa0e', '217e8514-093a-4d74-b378-a5091c69f5ba', '5704e4e3-8211-4e30-b474-06c668cf060d', '32ffe6c8-3c43-4477-ba28-405c32ea0087', '6588f3bb-b208-4ec7-8a50-1e573d683f24', 'cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37', '03708cfa-ea22-40d4-8c09-177242e076fa', 'a28c97db-60c3-43e3-8413-1620ac6f1f6d'} {{(pid=62842) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1244.639427] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1244.661223] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.661223] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.661223] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.661223] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.661509] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.661509] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1244.661509] env[62842]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=62842) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1244.661509] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1244.751033] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.751033] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.751033] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.751033] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.751871] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.752165] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1244.752247] env[62842]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=62842) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1244.752319] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1244.752383] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1244.752458] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/45 resources of Type:Security Group Rules [ 1244.752528] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ae20759e-0e4f-4e29-8897-7eb813e03b32 with Priority: HIGH for action security_group_rules [ 1244.752609] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 15e06d0a-ad75-4e9d-b1a6-db54b2f524a4 with Priority: HIGH for action security_group_rules [ 1244.752673] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 with Priority: HIGH for action security_group_rules [ 1244.752750] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 with Priority: HIGH for action security_group_rules [ 1244.752820] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311 with Priority: HIGH for action security_group_rules [ 1244.752877] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 with Priority: HIGH for action security_group_rules [ 1244.752934] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a9fd4555-77cd-4151-9f34-13bead661429 with Priority: HIGH for action security_group_rules [ 1244.752989] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c184a589-476a-49bd-9984-d339a77ec8f3 with Priority: HIGH for action security_group_rules [ 1244.753064] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1738c05b-4a1d-4a1c-8845-0b28fe6c81bb with Priority: HIGH for action security_group_rules [ 1244.753123] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1744456a-cfb4-4022-aed6-d7e18e95179b with Priority: HIGH for action security_group_rules [ 1244.753168] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 with Priority: HIGH for action security_group_rules [ 1244.753225] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 with Priority: HIGH for action security_group_rules [ 1244.753283] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 518e027d-4d1d-4cf5-a557-35f3eb956cd6 with Priority: HIGH for action security_group_rules [ 1244.753339] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 with Priority: HIGH for action security_group_rules [ 1244.753401] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 with Priority: HIGH for action security_group_rules [ 1244.753457] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a14df1d2-b3a6-4075-b15b-967892c37b7e with Priority: HIGH for action security_group_rules [ 1244.753510] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c0ccbbde-9e94-45de-b00c-8f135b84465d with Priority: HIGH for action security_group_rules [ 1244.753586] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ea061614-3b2c-4a61-a74b-32a4b42f10a1 with Priority: HIGH for action security_group_rules [ 1244.753635] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0d049bd9-2d2b-49fc-98b0-e67bd0e7171b with Priority: HIGH for action security_group_rules [ 1244.753693] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 with Priority: HIGH for action security_group_rules [ 1244.753799] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.700129] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1245.700495] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1245.700495] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae20759e-0e4f-4e29-8897-7eb813e03b32 with Priority: HIGH for action security_group_rules [ 1245.700495] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 with Priority: HIGH for action security_group_rules [ 1245.700816] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9fd4555-77cd-4151-9f34-13bead661429 with Priority: HIGH for action security_group_rules [ 1245.700816] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 with Priority: HIGH for action security_group_rules [ 1245.700911] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 with Priority: HIGH for action security_group_rules [ 1245.700956] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d049bd9-2d2b-49fc-98b0-e67bd0e7171b with Priority: HIGH for action security_group_rules [ 1245.701016] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea061614-3b2c-4a61-a74b-32a4b42f10a1 with Priority: HIGH for action security_group_rules [ 1245.701116] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0ccbbde-9e94-45de-b00c-8f135b84465d with Priority: HIGH for action security_group_rules [ 1245.701224] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 with Priority: HIGH for action security_group_rules [ 1245.701291] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a14df1d2-b3a6-4075-b15b-967892c37b7e with Priority: HIGH for action security_group_rules [ 1245.701380] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 518e027d-4d1d-4cf5-a557-35f3eb956cd6 with Priority: HIGH for action security_group_rules [ 1245.701469] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 with Priority: HIGH for action security_group_rules [ 1245.701557] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 with Priority: HIGH for action security_group_rules [ 1245.701643] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1744456a-cfb4-4022-aed6-d7e18e95179b with Priority: HIGH for action security_group_rules [ 1245.701729] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1738c05b-4a1d-4a1c-8845-0b28fe6c81bb with Priority: HIGH for action security_group_rules [ 1245.701817] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 with Priority: HIGH for action security_group_rules [ 1245.701905] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c184a589-476a-49bd-9984-d339a77ec8f3 with Priority: HIGH for action security_group_rules [ 1245.701990] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311 with Priority: HIGH for action security_group_rules [ 1245.702093] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15e06d0a-ad75-4e9d-b1a6-db54b2f524a4 with Priority: HIGH for action security_group_rules [ 1245.702221] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 with Priority: HIGH for action security_group_rules [ 1245.702518] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae20759e-0e4f-4e29-8897-7eb813e03b32 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.702660] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae20759e-0e4f-4e29-8897-7eb813e03b32" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.702743] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae20759e-0e4f-4e29-8897-7eb813e03b32" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.702987] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae20759e-0e4f-4e29-8897-7eb813e03b32" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.703123] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae20759e-0e4f-4e29-8897-7eb813e03b32',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.704180] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.704298] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.704338] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.704487] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.704561] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('77637a7d-8eb8-4f0e-a5bd-9870e0d191c6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.705349] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9fd4555-77cd-4151-9f34-13bead661429 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.705454] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9fd4555-77cd-4151-9f34-13bead661429" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.705506] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9fd4555-77cd-4151-9f34-13bead661429" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.705655] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9fd4555-77cd-4151-9f34-13bead661429" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.705723] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9fd4555-77cd-4151-9f34-13bead661429',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.706968] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-29a28398-6e5b-4a4f-81e9-a2f458468c19 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.707095] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.707095] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.707194] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.707422] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('29a28398-6e5b-4a4f-81e9-a2f458468c19',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.707979] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-331dd47d-e3b4-4338-b588-cd456a9aa5f7 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.708105] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.708149] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.708293] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.708353] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('331dd47d-e3b4-4338-b588-cd456a9aa5f7',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.709080] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0d049bd9-2d2b-49fc-98b0-e67bd0e7171b taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.709201] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0d049bd9-2d2b-49fc-98b0-e67bd0e7171b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.709256] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0d049bd9-2d2b-49fc-98b0-e67bd0e7171b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.709418] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0d049bd9-2d2b-49fc-98b0-e67bd0e7171b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.709463] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0d049bd9-2d2b-49fc-98b0-e67bd0e7171b',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.710139] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ea061614-3b2c-4a61-a74b-32a4b42f10a1 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.710242] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.710303] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.710448] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.710542] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ea061614-3b2c-4a61-a74b-32a4b42f10a1',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.711348] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0ccbbde-9e94-45de-b00c-8f135b84465d taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.711489] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0ccbbde-9e94-45de-b00c-8f135b84465d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.711545] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0ccbbde-9e94-45de-b00c-8f135b84465d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.711685] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0ccbbde-9e94-45de-b00c-8f135b84465d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.711755] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0ccbbde-9e94-45de-b00c-8f135b84465d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.712494] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-35146777-fd28-4ac7-b454-f7dd3fbb5846 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.712599] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.712662] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.712863] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.712948] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('35146777-fd28-4ac7-b454-f7dd3fbb5846',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.713628] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a14df1d2-b3a6-4075-b15b-967892c37b7e taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.713733] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a14df1d2-b3a6-4075-b15b-967892c37b7e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.713795] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a14df1d2-b3a6-4075-b15b-967892c37b7e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.713943] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a14df1d2-b3a6-4075-b15b-967892c37b7e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.714041] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a14df1d2-b3a6-4075-b15b-967892c37b7e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.714774] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-518e027d-4d1d-4cf5-a557-35f3eb956cd6 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.714883] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-518e027d-4d1d-4cf5-a557-35f3eb956cd6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.714947] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-518e027d-4d1d-4cf5-a557-35f3eb956cd6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.715108] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-518e027d-4d1d-4cf5-a557-35f3eb956cd6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.715178] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('518e027d-4d1d-4cf5-a557-35f3eb956cd6',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.717404] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e26630c-b3f7-4b48-9720-77b59135adf4 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.717527] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.717574] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.717717] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.717782] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e26630c-b3f7-4b48-9720-77b59135adf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.718440] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.718548] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.718633] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.718770] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.718851] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.719546] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1744456a-cfb4-4022-aed6-d7e18e95179b taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.719701] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1744456a-cfb4-4022-aed6-d7e18e95179b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.719755] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1744456a-cfb4-4022-aed6-d7e18e95179b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.719865] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1744456a-cfb4-4022-aed6-d7e18e95179b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.719932] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1744456a-cfb4-4022-aed6-d7e18e95179b',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.720676] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1738c05b-4a1d-4a1c-8845-0b28fe6c81bb taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.720784] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1738c05b-4a1d-4a1c-8845-0b28fe6c81bb" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.720841] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1738c05b-4a1d-4a1c-8845-0b28fe6c81bb" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.720979] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1738c05b-4a1d-4a1c-8845-0b28fe6c81bb" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.721056] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1738c05b-4a1d-4a1c-8845-0b28fe6c81bb',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.721699] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.721820] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.721873] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.722177] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.722177] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.722820] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c184a589-476a-49bd-9984-d339a77ec8f3 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.722903] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.722903] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.723060] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.723126] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c184a589-476a-49bd-9984-d339a77ec8f3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.723873] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.724031] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.724142] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.724369] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.724485] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.725523] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.725689] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.725800] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.726043] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.726135] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15e06d0a-ad75-4e9d-b1a6-db54b2f524a4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.727053] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a03224f-b75b-48a5-9e23-3ca50aabbb33 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.727197] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.727292] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.727509] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.727601] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a03224f-b75b-48a5-9e23-3ca50aabbb33',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.757496] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.757657] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.757703] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.757914] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.763041] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.763041] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.763533] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.763627] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.764420] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.764505] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.776996] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.777145] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae20759e-0e4f-4e29-8897-7eb813e03b32 is going to be deleted. [ 1245.778018] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.778230] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.796065] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.796590] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e26630c-b3f7-4b48-9720-77b59135adf4 is going to be deleted. [ 1245.797467] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.797679] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.816873] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.817059] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9fd4555-77cd-4151-9f34-13bead661429 is going to be deleted. [ 1245.817881] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.818094] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.841591] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.841772] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 29a28398-6e5b-4a4f-81e9-a2f458468c19 is going to be deleted. [ 1245.843191] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.843308] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.843381] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.843575] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.843658] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.843785] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e26630c-b3f7-4b48-9720-77b59135adf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.844419] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.844525] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.844591] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.844744] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.844824] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.844938] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae20759e-0e4f-4e29-8897-7eb813e03b32" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.867040] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.867237] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.867237] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.867439] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.867526] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.867640] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9fd4555-77cd-4151-9f34-13bead661429" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.894645] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.894868] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.894868] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.895083] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.895200] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.895324] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-29a28398-6e5b-4a4f-81e9-a2f458468c19" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.238530] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.238770] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.238770] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.238951] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.239124] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.239224] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.239289] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.239437] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.239522] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.239605] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.239693] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.377174] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.377438] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.377438] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.377614] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.379186] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.379382] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.380061] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.380169] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.380874] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.381019] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.381654] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.381788] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.382071] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.382159] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.383199] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.383289] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.383978] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.384086] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.384725] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.384817] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.385572] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.385652] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.386331] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.386432] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.387038] env[62842]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1246.387458] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.387550] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.388157] env[62842]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1246.388592] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.388683] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.389317] env[62842]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1246.389713] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.389805] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.391069] env[62842]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1246.391444] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.391536] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.410674] env[62842]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1246.411198] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.411325] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1738c05b-4a1d-4a1c-8845-0b28fe6c81bb is going to be deleted. [ 1246.412218] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.412429] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.429684] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.429835] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0d049bd9-2d2b-49fc-98b0-e67bd0e7171b is going to be deleted. [ 1246.430676] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.430907] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.448305] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.448486] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1744456a-cfb4-4022-aed6-d7e18e95179b is going to be deleted. [ 1246.449320] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.449528] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.468751] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.468943] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0ccbbde-9e94-45de-b00c-8f135b84465d is going to be deleted. [ 1246.469822] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.470042] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.471377] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.471515] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.492540] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.492783] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.494026] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.494149] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a03224f-b75b-48a5-9e23-3ca50aabbb33 is going to be deleted. [ 1246.494988] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.495212] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.517754] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.517960] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.518767] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.518884] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a14df1d2-b3a6-4075-b15b-967892c37b7e is going to be deleted. [ 1246.519758] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.519971] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.541366] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.541540] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 331dd47d-e3b4-4338-b588-cd456a9aa5f7 is going to be deleted. [ 1246.542392] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.542606] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.569496] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.569704] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.574798] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.574946] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.601791] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.601994] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c184a589-476a-49bd-9984-d339a77ec8f3 is going to be deleted. [ 1246.602904] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.603122] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.612726] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.612940] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.660841] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.661012] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ea061614-3b2c-4a61-a74b-32a4b42f10a1 is going to be deleted. [ 1246.661879] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.662115] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.707668] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.708093] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.711128] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.711281] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 77637a7d-8eb8-4f0e-a5bd-9870e0d191c6 is going to be deleted. [ 1246.712137] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.712347] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.713709] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.713807] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.750155] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.750409] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.750409] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.750585] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.750756] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.750863] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.750932] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.751160] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.751279] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.751371] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.751524] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.751620] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.751680] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.751827] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.751971] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.752081] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.752144] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.752283] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.752361] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.752441] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.752531] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.767009] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.767247] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 35146777-fd28-4ac7-b454-f7dd3fbb5846 is going to be deleted. [ 1246.768029] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.768240] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.774668] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.774841] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.832524] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.832756] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 518e027d-4d1d-4cf5-a557-35f3eb956cd6 is going to be deleted. [ 1246.833641] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.833866] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.866843] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.867082] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.868604] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.868733] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393 is going to be deleted. [ 1246.869644] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.869861] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.894062] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.894300] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.943274] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.943473] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311 is going to be deleted. [ 1246.944349] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.944570] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.956986] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.957202] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.013963] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.014142] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15e06d0a-ad75-4e9d-b1a6-db54b2f524a4 is going to be deleted. [ 1247.015021] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.015251] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.015346] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.015471] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1738c05b-4a1d-4a1c-8845-0b28fe6c81bb" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.015627] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.015773] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.015852] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.015965] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0d049bd9-2d2b-49fc-98b0-e67bd0e7171b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.016482] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.016635] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.016715] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.016840] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1744456a-cfb4-4022-aed6-d7e18e95179b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.016997] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.017157] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.017235] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.017351] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0ccbbde-9e94-45de-b00c-8f135b84465d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.017494] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.017633] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.017709] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.017826] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a03224f-b75b-48a5-9e23-3ca50aabbb33" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.017971] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.018114] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.018189] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.018293] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a14df1d2-b3a6-4075-b15b-967892c37b7e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.018415] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.018550] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.018621] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.018727] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-331dd47d-e3b4-4338-b588-cd456a9aa5f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.018848] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.018999] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.019086] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.019222] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c184a589-476a-49bd-9984-d339a77ec8f3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.019364] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.019505] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.019578] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.019681] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ea061614-3b2c-4a61-a74b-32a4b42f10a1" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.019803] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.019937] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.020020] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.020130] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-35146777-fd28-4ac7-b454-f7dd3fbb5846" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.020252] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.020386] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.020459] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.020563] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-77637a7d-8eb8-4f0e-a5bd-9870e0d191c6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.020684] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.020861] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.020954] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.021076] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-518e027d-4d1d-4cf5-a557-35f3eb956cd6" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.034803] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.034985] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.035057] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.035213] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.035300] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.035434] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c9a1c47-0b3b-4e0b-b8f7-6c7d2e67e393" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.076670] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.076880] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.076880] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.077101] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.077194] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.077318] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0ede0d4-fb64-4f76-8ab4-4f7ee57b3311" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.144686] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.144911] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.144911] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.145135] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.145230] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.145355] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15e06d0a-ad75-4e9d-b1a6-db54b2f524a4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.255241] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4: rpc.has_security_group_logging(os_id): False [ 1247.282378] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.282613] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.282613] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.282855] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.305769] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.306038] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.306165] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.306230] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.306426] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.306508] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.306707] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.306804] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.306865] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.307016] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.307149] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.307344] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.307441] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.307495] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.307641] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.307717] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.307802] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 is going to be updated. [ 1247.382584] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.382838] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.382838] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.383056] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.383221] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.395976] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 in Status: IN_PROGRESS for 2s [ 1249.210127] env[62842]: INFO networking_nsxv3.common.synchronization [req-f46e3b4b-3d5d-4d6d-b989-938a28b02f69 req-3aae1bb9-0e52-4144-961c-56f90f136a5b tempest-ServersNegativeTestJSON-1512249164 tempest-ServersNegativeTestJSON-1512249164-project-member] Enqueued Resource ID: 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 with Priority: HIGHEST for action security_group_members [ 1249.210668] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 with Priority: HIGHEST for action security_group_members [ 1249.211040] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.211177] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.211242] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.211441] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.211598] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.211711] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.211764] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.211917] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.212082] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.212129] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.411124] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 in Status: SUCCESS [ 1249.411358] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.482591] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-128 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.482831] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-128" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.482976] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-128" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.483306] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-128" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.483576] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.483742] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.483865] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.484143] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.484306] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.484521] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1249.484637] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1249.484792] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1249.484931] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1249.485064] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1249.485205] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1249.485346] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1249.504554] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1249.504834] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1249.505091] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1249.505390] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-128" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.505888] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-e94d2840-d857-4c8d-bbd7-6fda5d4788f7 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.506197] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-e94d2840-d857-4c8d-bbd7-6fda5d4788f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.506436] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-e94d2840-d857-4c8d-bbd7-6fda5d4788f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.506867] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-e94d2840-d857-4c8d-bbd7-6fda5d4788f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.507036] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e94d2840-d857-4c8d-bbd7-6fda5d4788f7',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.718688] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.010108] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.010324] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.010461] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.010752] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.010917] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.011093] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port e94d2840-d857-4c8d-bbd7-6fda5d4788f7 not found, creating... [ 1250.011410] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.011565] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.011632] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.011860] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.011997] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.012329] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.012594] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.012669] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.012860] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.013015] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.013201] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: e94d2840-d857-4c8d-bbd7-6fda5d4788f7 is going to be created. [ 1250.033177] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.033377] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.033501] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.033754] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.033995] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.034253] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-e94d2840-d857-4c8d-bbd7-6fda5d4788f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.221241] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.704508] env[62842]: INFO networking_nsxv3.common.synchronization [req-f46e3b4b-3d5d-4d6d-b989-938a28b02f69 req-5b44da71-e2aa-437d-a1a1-9f350f5d3fea service nova] Enqueued Resource ID: 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 with Priority: HIGHEST for action security_group_rules [ 1250.704666] env[62842]: INFO networking_nsxv3.common.synchronization [req-f46e3b4b-3d5d-4d6d-b989-938a28b02f69 req-5b44da71-e2aa-437d-a1a1-9f350f5d3fea service nova] Enqueued Resource ID: 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 with Priority: HIGHEST for action security_group_members [ 1250.704804] env[62842]: INFO networking_nsxv3.common.synchronization [req-f46e3b4b-3d5d-4d6d-b989-938a28b02f69 req-5b44da71-e2aa-437d-a1a1-9f350f5d3fea service nova] Enqueued Resource ID: e94d2840-d857-4c8d-bbd7-6fda5d4788f7 with Priority: HIGHEST for action port [ 1250.705062] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 with Priority: HIGHEST for action security_group_rules [ 1250.705191] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 with Priority: HIGHEST for action security_group_members [ 1250.705288] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e94d2840-d857-4c8d-bbd7-6fda5d4788f7 with Priority: HIGHEST for action port [ 1250.706236] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.706368] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.706437] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.706635] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.706717] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.708120] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.708120] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.708299] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-e94d2840-d857-4c8d-bbd7-6fda5d4788f7 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.708398] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e94d2840-d857-4c8d-bbd7-6fda5d4788f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.708462] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e94d2840-d857-4c8d-bbd7-6fda5d4788f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.708619] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e94d2840-d857-4c8d-bbd7-6fda5d4788f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.708693] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e94d2840-d857-4c8d-bbd7-6fda5d4788f7',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.724137] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.724359] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.724359] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.724529] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.724630] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.724705] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 is going to be updated. [ 1250.752557] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.752773] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.752773] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.752994] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.753126] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.761267] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 in Status: IN_PROGRESS for 2s [ 1251.208478] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.208612] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.210971] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e94d2840-d857-4c8d-bbd7-6fda5d4788f7 with status ACTIVE [ 1251.211152] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.211270] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.211338] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.211543] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.211631] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.211799] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.211930] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.211994] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.212111] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.212195] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.212377] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.212469] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.212525] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.212660] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.212734] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.212852] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e94d2840-d857-4c8d-bbd7-6fda5d4788f7 is going to be updated. [ 1251.233643] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.234206] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.234206] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.234206] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.234394] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.234394] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e94d2840-d857-4c8d-bbd7-6fda5d4788f7" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.770940] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 in Status: SUCCESS [ 1252.771370] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.771370] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.771588] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.771794] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.771920] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.771987] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.772165] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.772248] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.772344] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.274438] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.777369] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.280143] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.280412] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.280412] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.280592] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.280816] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.280816] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 is going to be updated. [ 1254.313147] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.313357] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.313357] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.313574] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.313702] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.322702] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 in Status: IN_PROGRESS for 2s [ 1255.706744] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1255.706744] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1256.334094] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 in Status: SUCCESS [ 1256.334269] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.334427] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.334638] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.334829] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.334977] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.335062] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.335226] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.335308] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.335397] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.335489] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.838067] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.838476] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.838476] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.838558] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.838670] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.838767] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.838832] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.838980] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.839082] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.839172] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.839319] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.839412] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.839472] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.839609] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.839746] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.839835] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.839917] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.840077] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.840155] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.840235] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.840324] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.342269] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4: rpc.has_security_group_logging(os_id): False [ 1257.359653] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.359824] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.359865] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.360080] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.360174] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.360369] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.360540] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.360540] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.360687] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.360758] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.360935] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.361047] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.361107] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.361246] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.361320] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.361510] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.361603] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.361663] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.361797] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.361868] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.361952] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 is going to be updated. [ 1257.421646] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.421843] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.421843] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.422055] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.422220] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.436176] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 in Status: IN_PROGRESS for 2s [ 1259.460456] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 in Status: SUCCESS [ 1259.460917] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.313979] env[62842]: INFO networking_nsxv3.common.synchronization [req-f9eec18d-1e5e-4162-984c-9e55d73c6708 req-8b1f3c16-a63b-4e5c-a2e0-eb90a2e055d6 tempest-ServersNegativeTestJSON-1512249164 tempest-ServersNegativeTestJSON-1512249164-project-member] Enqueued Resource ID: 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 with Priority: HIGHEST for action security_group_members [ 1260.314520] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 with Priority: HIGHEST for action security_group_members [ 1260.314847] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.314973] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.315080] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.315274] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.315429] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.315530] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.315591] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.315731] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.315817] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.315907] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.818077] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.320612] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.824474] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.824912] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.824912] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.824912] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.825075] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.825075] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 is going to be updated. [ 1261.858031] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.858031] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.858031] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.858031] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.858380] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.867967] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 in Status: IN_PROGRESS for 2s [ 1263.879492] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 in Status: SUCCESS [ 1263.880159] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.315853] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1265.316254] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1270.317427] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1270.317794] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1275.318663] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1275.319126] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1280.320402] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1280.320402] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1285.322039] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1285.322405] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1290.322940] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1290.323426] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1295.324258] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1295.324554] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1300.325450] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1300.325848] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1302.571334] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-128 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.571658] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-128" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.571658] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-128" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.571931] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-128" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.572210] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.572376] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.572496] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.572714] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.572862] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.573127] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1302.573262] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1302.573380] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1302.573493] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1302.573607] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1302.573716] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1302.573851] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1302.594697] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1302.594879] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1302.595010] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1302.595193] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-128" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.595516] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-295ad5a5-9d01-4023-89e9-d3f3e7dae4be taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.595687] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-295ad5a5-9d01-4023-89e9-d3f3e7dae4be" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.595823] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-295ad5a5-9d01-4023-89e9-d3f3e7dae4be" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.596078] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-295ad5a5-9d01-4023-89e9-d3f3e7dae4be" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.596223] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('295ad5a5-9d01-4023-89e9-d3f3e7dae4be',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.098566] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.098800] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.098900] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.099237] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.099412] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.099713] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.099884] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.100023] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.100275] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.100417] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.100721] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.100902] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.101044] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.101281] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.101440] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.101602] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 295ad5a5-9d01-4023-89e9-d3f3e7dae4be is going to be updated. [ 1303.124621] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.124843] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.124985] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.125309] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.125524] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.125750] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-295ad5a5-9d01-4023-89e9-d3f3e7dae4be" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.826276] env[62842]: INFO networking_nsxv3.common.synchronization [req-60e98e29-ce1e-441c-be6f-ec3d70ab4789 req-4a46179d-af85-4d94-90fe-3195d53abc56 service nova] Enqueued Resource ID: 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 with Priority: HIGHEST for action security_group_rules [ 1303.826541] env[62842]: INFO networking_nsxv3.common.synchronization [req-60e98e29-ce1e-441c-be6f-ec3d70ab4789 req-4a46179d-af85-4d94-90fe-3195d53abc56 service nova] Enqueued Resource ID: 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 with Priority: HIGHEST for action security_group_members [ 1303.826541] env[62842]: INFO networking_nsxv3.common.synchronization [req-60e98e29-ce1e-441c-be6f-ec3d70ab4789 req-4a46179d-af85-4d94-90fe-3195d53abc56 service nova] Enqueued Resource ID: 295ad5a5-9d01-4023-89e9-d3f3e7dae4be with Priority: HIGHEST for action port [ 1303.826774] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 with Priority: HIGHEST for action security_group_rules [ 1303.826905] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 with Priority: HIGHEST for action security_group_members [ 1303.826999] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 295ad5a5-9d01-4023-89e9-d3f3e7dae4be with Priority: HIGHEST for action port [ 1303.827579] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.828808] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.828890] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.829112] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.829227] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.830040] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.830159] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.830273] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.830409] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.831030] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.831030] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.831030] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.831030] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.831364] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.831364] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.831947] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-295ad5a5-9d01-4023-89e9-d3f3e7dae4be taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.832085] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-295ad5a5-9d01-4023-89e9-d3f3e7dae4be" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.832182] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-295ad5a5-9d01-4023-89e9-d3f3e7dae4be" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.832868] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-295ad5a5-9d01-4023-89e9-d3f3e7dae4be" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.832997] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('295ad5a5-9d01-4023-89e9-d3f3e7dae4be',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.335219] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.336309] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.336441] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.337254] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 295ad5a5-9d01-4023-89e9-d3f3e7dae4be with status ACTIVE [ 1304.337460] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.337574] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.337641] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.337848] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.337941] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.338120] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.338241] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.338300] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.338433] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.338511] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.338686] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.338779] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.338835] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.338989] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.339063] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.339130] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 295ad5a5-9d01-4023-89e9-d3f3e7dae4be is going to be updated. [ 1304.359737] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.359952] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.359952] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.360178] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.360320] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.360476] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-295ad5a5-9d01-4023-89e9-d3f3e7dae4be" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.838256] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.340522] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.340806] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.340806] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.340935] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.340974] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.341100] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 is going to be updated. [ 1305.371774] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.372062] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.372062] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.372245] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.372418] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.381449] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 in Status: IN_PROGRESS for 2s [ 1307.392233] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 in Status: SUCCESS [ 1307.392652] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.392652] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.392893] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.393124] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.393285] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.393370] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.393523] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.393610] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.393684] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.393772] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.896086] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.896305] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.896421] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.896553] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.896718] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.896828] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.896888] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.897052] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.897146] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.897237] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.897383] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.897470] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.897544] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.897689] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.897826] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.897914] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.897978] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.898111] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.898203] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.898287] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.898378] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.401355] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4: rpc.has_security_group_logging(os_id): False [ 1308.423691] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.423875] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.423927] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.424141] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.424236] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.424426] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.424534] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.424588] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.424833] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.424833] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.424992] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.425098] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.425159] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.425303] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.425375] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.425570] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.425664] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.425749] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.425910] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.425983] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.426082] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 is going to be updated. [ 1308.565499] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.565752] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.565752] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.565911] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.566070] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.581144] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 in Status: IN_PROGRESS for 2s [ 1308.828126] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1308.828317] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1310.598892] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 in Status: SUCCESS [ 1310.598892] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.828970] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1313.829486] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1318.829688] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1318.830135] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1323.831444] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1323.831444] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1328.832390] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1328.832863] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1331.665577] env[62842]: INFO networking_nsxv3.common.synchronization [req-8396cd21-88cf-40d8-8ad6-111585532169 req-b9e2559b-55b7-44bf-a08a-922f54320649 tempest-ServersNegativeTestJSON-1512249164 tempest-ServersNegativeTestJSON-1512249164-project-member] Enqueued Resource ID: 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 with Priority: HIGHEST for action security_group_members [ 1331.665932] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 with Priority: HIGHEST for action security_group_members [ 1331.666248] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.666359] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.666435] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.666611] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.666765] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.666877] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.669269] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.669269] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.669269] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.669269] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.171072] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.171072] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.171072] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.171072] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.171072] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.171072] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.171072] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.171718] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.171718] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.171718] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.171718] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 is going to be updated. [ 1332.198582] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.198799] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.198799] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.198989] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.199145] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.207949] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 in Status: IN_PROGRESS for 2s [ 1334.222452] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 in Status: SUCCESS [ 1334.222883] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 deletion is rescheduled due to dependency. [ 1334.222883] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.667601] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1336.667601] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1341.669091] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1341.669091] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1346.670598] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1346.670598] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1349.508470] env[62842]: INFO networking_nsxv3.common.synchronization [req-0edf6fd1-aebc-4feb-bf81-f7261167fb18 req-03c52330-6102-4f8d-b1f7-52cf5b34be44 tempest-ServerActionsTestOtherB-1524579062 tempest-ServerActionsTestOtherB-1524579062-project-member] Enqueued Resource ID: 513f9fc9-fb62-455e-82a3-541765c9b912 with Priority: HIGHEST for action security_group_members [ 1349.509514] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 513f9fc9-fb62-455e-82a3-541765c9b912 with Priority: HIGHEST for action security_group_members [ 1349.509926] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-513f9fc9-fb62-455e-82a3-541765c9b912 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.509926] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.510153] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.510888] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.510888] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.510888] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.510888] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.510888] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.510888] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.511800] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('513f9fc9-fb62-455e-82a3-541765c9b912',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1350.013127] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.013127] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.013393] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.013393] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.033339] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.033682] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.033798] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.033847] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.034013] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.034112] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.034207] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 513f9fc9-fb62-455e-82a3-541765c9b912 is going to be updated. [ 1350.060069] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.060273] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.060273] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.060454] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.060647] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.070202] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 513f9fc9-fb62-455e-82a3-541765c9b912 in Status: IN_PROGRESS for 2s [ 1352.081315] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 513f9fc9-fb62-455e-82a3-541765c9b912 in Status: SUCCESS [ 1352.081719] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 513f9fc9-fb62-455e-82a3-541765c9b912 deletion is rescheduled due to dependency. [ 1352.081719] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.510408] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1354.510816] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1356.463363] env[62842]: INFO networking_nsxv3.common.synchronization [req-10c593b5-55f2-4064-94da-0d494587eb4c req-42fba2c2-50cd-402f-b3a9-82a37ba1f654 tempest-ServerActionsTestOtherB-1524579062 tempest-ServerActionsTestOtherB-1524579062-project-member] Enqueued Resource ID: 513f9fc9-fb62-455e-82a3-541765c9b912 with Priority: HIGHEST for action security_group_members [ 1356.464077] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 513f9fc9-fb62-455e-82a3-541765c9b912 with Priority: HIGHEST for action security_group_members [ 1356.464458] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-513f9fc9-fb62-455e-82a3-541765c9b912 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.464540] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.464638] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.464816] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.464965] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.465100] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.465174] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.465308] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.465387] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.465477] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('513f9fc9-fb62-455e-82a3-541765c9b912',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1356.968286] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.968463] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.968508] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.968742] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.968840] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.969051] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.969163] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.969230] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.969363] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.969442] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.969538] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 513f9fc9-fb62-455e-82a3-541765c9b912 is going to be updated. [ 1356.997275] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.997489] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.997607] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.997835] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.998057] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.008011] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 513f9fc9-fb62-455e-82a3-541765c9b912 in Status: IN_PROGRESS for 2s [ 1357.042377] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-246 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.042673] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-246" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.042874] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-246" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.043200] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-246" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.043492] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.043684] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.043808] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.044046] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.044203] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.044420] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1357.044587] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1357.044712] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1357.044828] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1357.044948] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1357.045078] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1357.045220] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1357.064596] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1357.064794] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1357.064940] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1357.065113] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-246" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.065436] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-499011c9-523a-4494-9108-58a1bb091d8f taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.065719] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-499011c9-523a-4494-9108-58a1bb091d8f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.065907] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-499011c9-523a-4494-9108-58a1bb091d8f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.066271] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-499011c9-523a-4494-9108-58a1bb091d8f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.066421] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('499011c9-523a-4494-9108-58a1bb091d8f',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1357.568993] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.569475] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.569475] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.569688] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.569878] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.570077] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 499011c9-523a-4494-9108-58a1bb091d8f not found, creating... [ 1357.570366] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.570545] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.570680] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.571037] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.571089] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.571418] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.571635] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.571759] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.572000] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.572152] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.572304] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 499011c9-523a-4494-9108-58a1bb091d8f is going to be created. [ 1357.598486] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.598734] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.598865] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.599182] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.599423] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.599639] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-499011c9-523a-4494-9108-58a1bb091d8f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.331972] env[62842]: INFO networking_nsxv3.common.synchronization [req-10c593b5-55f2-4064-94da-0d494587eb4c req-967962b6-ebb8-4eef-a081-dbd14a5f25f6 service nova] Enqueued Resource ID: 513f9fc9-fb62-455e-82a3-541765c9b912 with Priority: HIGHEST for action security_group_rules [ 1358.332189] env[62842]: INFO networking_nsxv3.common.synchronization [req-10c593b5-55f2-4064-94da-0d494587eb4c req-967962b6-ebb8-4eef-a081-dbd14a5f25f6 service nova] Enqueued Resource ID: 513f9fc9-fb62-455e-82a3-541765c9b912 with Priority: HIGHEST for action security_group_members [ 1358.332335] env[62842]: INFO networking_nsxv3.common.synchronization [req-10c593b5-55f2-4064-94da-0d494587eb4c req-967962b6-ebb8-4eef-a081-dbd14a5f25f6 service nova] Enqueued Resource ID: 499011c9-523a-4494-9108-58a1bb091d8f with Priority: HIGHEST for action port [ 1358.332854] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 513f9fc9-fb62-455e-82a3-541765c9b912 with Priority: HIGHEST for action security_group_rules [ 1358.332993] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 513f9fc9-fb62-455e-82a3-541765c9b912 with Priority: HIGHEST for action security_group_members [ 1358.333378] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 499011c9-523a-4494-9108-58a1bb091d8f with Priority: HIGHEST for action port [ 1358.333638] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-513f9fc9-fb62-455e-82a3-541765c9b912 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.333787] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.333904] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.334031] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.334110] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('513f9fc9-fb62-455e-82a3-541765c9b912',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.338156] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-513f9fc9-fb62-455e-82a3-541765c9b912 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.338336] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.338638] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-499011c9-523a-4494-9108-58a1bb091d8f taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.338756] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-499011c9-523a-4494-9108-58a1bb091d8f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.338823] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-499011c9-523a-4494-9108-58a1bb091d8f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.339037] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-499011c9-523a-4494-9108-58a1bb091d8f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.339121] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('499011c9-523a-4494-9108-58a1bb091d8f',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.841678] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-513f9fc9-fb62-455e-82a3-541765c9b912 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.841973] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.842028] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 499011c9-523a-4494-9108-58a1bb091d8f with status ACTIVE [ 1358.842995] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.842995] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.842995] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.842995] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.842995] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.842995] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.842995] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.842995] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.843463] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.843463] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.843463] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.843463] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.843463] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.843708] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.843748] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.843810] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 499011c9-523a-4494-9108-58a1bb091d8f is going to be updated. [ 1358.867342] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.867583] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.867681] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.868016] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.868248] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.868498] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-499011c9-523a-4494-9108-58a1bb091d8f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.018278] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 513f9fc9-fb62-455e-82a3-541765c9b912 in Status: SUCCESS [ 1359.018459] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 513f9fc9-fb62-455e-82a3-541765c9b912 deletion is rescheduled due to dependency. [ 1359.018547] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.018750] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.018988] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.019194] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.019316] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.019380] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.019532] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.019616] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.019729] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('513f9fc9-fb62-455e-82a3-541765c9b912',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1359.521619] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('513f9fc9-fb62-455e-82a3-541765c9b912',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1360.024049] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('513f9fc9-fb62-455e-82a3-541765c9b912',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1360.527218] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.527462] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.527462] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.527648] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.527715] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.527802] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 513f9fc9-fb62-455e-82a3-541765c9b912 is going to be updated. [ 1360.554731] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.554876] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.554947] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.555158] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.555307] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.564295] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 513f9fc9-fb62-455e-82a3-541765c9b912 in Status: IN_PROGRESS for 2s [ 1362.576137] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 513f9fc9-fb62-455e-82a3-541765c9b912 in Status: SUCCESS [ 1362.576540] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.576540] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.576757] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.576933] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.577068] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.577127] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.577286] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.577365] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.577451] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.577545] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('513f9fc9-fb62-455e-82a3-541765c9b912',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1363.080419] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('513f9fc9-fb62-455e-82a3-541765c9b912',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1363.334793] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1363.335059] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1363.583466] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 513f9fc9-fb62-455e-82a3-541765c9b912: rpc.has_security_group_logging(os_id): False [ 1363.601826] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.602150] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.602150] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.602258] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.602294] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.602543] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.602643] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.602704] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.602855] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.602930] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.603025] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 513f9fc9-fb62-455e-82a3-541765c9b912 is going to be updated. [ 1363.660655] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.660948] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.661049] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.661413] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.661679] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.683275] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 513f9fc9-fb62-455e-82a3-541765c9b912 in Status: IN_PROGRESS for 2s [ 1365.697445] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 513f9fc9-fb62-455e-82a3-541765c9b912 in Status: SUCCESS [ 1365.697796] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.336022] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1368.336474] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1373.337542] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1373.337938] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1378.338272] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1378.339111] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1383.340062] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1383.340062] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1388.341308] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1388.342061] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1393.342754] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1393.343210] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1398.344261] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1398.344751] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1403.344937] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1403.345381] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1408.345637] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1408.345637] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1413.347120] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1413.347120] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1418.347776] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1418.348227] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1423.348360] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1423.348758] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1428.349354] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1428.349725] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1433.349995] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1433.350320] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1438.351563] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1438.352074] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1443.352626] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1443.353067] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1448.353593] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1448.353593] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1453.354943] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1453.354943] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1453.911785] env[62842]: INFO networking_nsxv3.common.synchronization [req-4cdf653b-e353-4417-b875-4cef5019f163 req-7a45eb97-a797-4097-8539-c7719d813f24 tempest-ServerActionsTestOtherB-1524579062 tempest-ServerActionsTestOtherB-1524579062-project-member] Enqueued Resource ID: 513f9fc9-fb62-455e-82a3-541765c9b912 with Priority: HIGHEST for action security_group_members [ 1453.912509] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 513f9fc9-fb62-455e-82a3-541765c9b912 with Priority: HIGHEST for action security_group_members [ 1453.913028] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-513f9fc9-fb62-455e-82a3-541765c9b912 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.913305] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.913470] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.913772] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.914039] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1453.914285] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1453.914445] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1453.914723] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1453.914915] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1453.915220] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('513f9fc9-fb62-455e-82a3-541765c9b912',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1454.418069] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.418497] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.418497] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1454.418596] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1454.418680] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1454.418911] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.419035] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.419080] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1454.419221] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1454.419308] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1454.419419] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 513f9fc9-fb62-455e-82a3-541765c9b912 is going to be updated. [ 1454.455112] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1454.455339] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1454.455339] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1454.455527] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1454.455666] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1454.464253] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 513f9fc9-fb62-455e-82a3-541765c9b912 in Status: IN_PROGRESS for 2s [ 1456.476468] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 513f9fc9-fb62-455e-82a3-541765c9b912 in Status: SUCCESS [ 1456.476884] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 513f9fc9-fb62-455e-82a3-541765c9b912 deletion is rescheduled due to dependency. [ 1456.476884] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1458.914307] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1458.914683] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1460.082883] env[62842]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1460.083338] env[62842]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ee94bdad-8042-49cc-94bc-9b9972604399 None None] NSXv3 Agent Agent loop - iteration:4 started [ 1462.182559] env[62842]: INFO networking_nsxv3.common.synchronization [req-3807745e-58fe-4607-86ee-6d4053a32cc4 req-310ea990-0e4d-40c6-ad59-fc2fd274ab21 tempest-ServerActionsTestOtherB-1524579062 tempest-ServerActionsTestOtherB-1524579062-project-member] Enqueued Resource ID: 513f9fc9-fb62-455e-82a3-541765c9b912 with Priority: HIGHEST for action security_group_members [ 1462.183192] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 513f9fc9-fb62-455e-82a3-541765c9b912 with Priority: HIGHEST for action security_group_members [ 1462.183520] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-513f9fc9-fb62-455e-82a3-541765c9b912 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.183650] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.183719] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.183906] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.184078] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.184187] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.184285] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.184409] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.184665] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.184665] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('513f9fc9-fb62-455e-82a3-541765c9b912',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1462.479862] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-246 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.480078] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-246" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.480232] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-246" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.480525] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-246" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.480856] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.480958] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.481086] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.481300] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.481449] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.481661] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1462.481776] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1462.481887] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1462.481996] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1462.482119] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1462.482227] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1462.482363] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1462.504105] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1462.504337] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1462.504389] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1462.504586] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-246" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.504912] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-8b5c141e-6bbe-4781-812a-2bc4061c2f7d taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.505111] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-8b5c141e-6bbe-4781-812a-2bc4061c2f7d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.505238] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-8b5c141e-6bbe-4781-812a-2bc4061c2f7d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.505588] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-8b5c141e-6bbe-4781-812a-2bc4061c2f7d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.505716] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b5c141e-6bbe-4781-812a-2bc4061c2f7d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1462.686848] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.687118] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.687118] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.687316] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.687370] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.687555] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.687655] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.687715] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.687859] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.687934] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.688032] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 513f9fc9-fb62-455e-82a3-541765c9b912 is going to be updated. [ 1462.722420] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.722668] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.722668] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.722808] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.722950] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.731891] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 513f9fc9-fb62-455e-82a3-541765c9b912 in Status: IN_PROGRESS for 2s [ 1463.008474] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1463.008697] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1463.008782] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1463.009078] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1463.009240] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1463.009485] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Segment Port 8b5c141e-6bbe-4781-812a-2bc4061c2f7d not found, creating... [ 1463.009848] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1463.010099] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1463.010247] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1463.010482] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1463.010626] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1463.010942] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1463.011136] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1463.011261] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1463.011475] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1463.011616] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1463.011759] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 8b5c141e-6bbe-4781-812a-2bc4061c2f7d is going to be created. [ 1463.034493] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1463.034723] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1463.034816] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1463.035093] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1463.035340] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1463.035573] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-8b5c141e-6bbe-4781-812a-2bc4061c2f7d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1463.727494] env[62842]: INFO networking_nsxv3.common.synchronization [req-3807745e-58fe-4607-86ee-6d4053a32cc4 req-36f12f9e-deeb-4a69-8def-17e7e29e56fe service nova] Enqueued Resource ID: 513f9fc9-fb62-455e-82a3-541765c9b912 with Priority: HIGHEST for action security_group_rules [ 1463.727818] env[62842]: INFO networking_nsxv3.common.synchronization [req-3807745e-58fe-4607-86ee-6d4053a32cc4 req-36f12f9e-deeb-4a69-8def-17e7e29e56fe service nova] Enqueued Resource ID: 513f9fc9-fb62-455e-82a3-541765c9b912 with Priority: HIGHEST for action security_group_members [ 1463.727818] env[62842]: INFO networking_nsxv3.common.synchronization [req-3807745e-58fe-4607-86ee-6d4053a32cc4 req-36f12f9e-deeb-4a69-8def-17e7e29e56fe service nova] Enqueued Resource ID: 8b5c141e-6bbe-4781-812a-2bc4061c2f7d with Priority: HIGHEST for action port [ 1463.728058] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 513f9fc9-fb62-455e-82a3-541765c9b912 with Priority: HIGHEST for action security_group_rules [ 1463.728188] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 513f9fc9-fb62-455e-82a3-541765c9b912 with Priority: HIGHEST for action security_group_members [ 1463.728283] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b5c141e-6bbe-4781-812a-2bc4061c2f7d with Priority: HIGHEST for action port [ 1463.729349] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-513f9fc9-fb62-455e-82a3-541765c9b912 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1463.729532] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1463.729640] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1463.729884] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1463.730018] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('513f9fc9-fb62-455e-82a3-541765c9b912',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1463.730885] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-513f9fc9-fb62-455e-82a3-541765c9b912 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1463.731080] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1463.731329] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-8b5c141e-6bbe-4781-812a-2bc4061c2f7d taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1463.731479] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8b5c141e-6bbe-4781-812a-2bc4061c2f7d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1463.731580] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8b5c141e-6bbe-4781-812a-2bc4061c2f7d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1463.731780] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8b5c141e-6bbe-4781-812a-2bc4061c2f7d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1463.731906] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b5c141e-6bbe-4781-812a-2bc4061c2f7d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1464.233655] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-513f9fc9-fb62-455e-82a3-541765c9b912 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1464.233908] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1464.236171] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8b5c141e-6bbe-4781-812a-2bc4061c2f7d with status ACTIVE [ 1464.236341] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1464.236458] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1464.236525] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1464.236789] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1464.236851] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1464.236981] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1464.237091] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1464.237142] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1464.237293] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1464.237370] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1464.237547] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1464.237637] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1464.237697] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1464.237832] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1464.237904] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1464.237984] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8b5c141e-6bbe-4781-812a-2bc4061c2f7d is going to be updated. [ 1464.258562] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1464.258774] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1464.258774] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1464.258935] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1464.259081] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1464.259240] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8b5c141e-6bbe-4781-812a-2bc4061c2f7d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1464.742102] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 513f9fc9-fb62-455e-82a3-541765c9b912 in Status: SUCCESS [ 1464.742521] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 513f9fc9-fb62-455e-82a3-541765c9b912 deletion is rescheduled due to dependency. [ 1464.742521] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1464.742625] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1464.742757] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1464.742938] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1464.743067] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1464.743131] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1464.743282] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1464.743367] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1464.743486] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('513f9fc9-fb62-455e-82a3-541765c9b912',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1465.245425] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('513f9fc9-fb62-455e-82a3-541765c9b912',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1465.747945] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('513f9fc9-fb62-455e-82a3-541765c9b912',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1466.252031] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1466.252031] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1466.252031] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1466.252031] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1466.252031] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1466.252031] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 513f9fc9-fb62-455e-82a3-541765c9b912 is going to be updated. [ 1466.279106] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1466.279387] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1466.279387] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1466.279585] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1466.279677] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1466.288584] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 513f9fc9-fb62-455e-82a3-541765c9b912 in Status: IN_PROGRESS for 2s [ 1468.299932] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 513f9fc9-fb62-455e-82a3-541765c9b912 in Status: SUCCESS [ 1468.300314] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1468.300314] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1468.300478] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1468.300659] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1468.300783] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1468.300850] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1468.301014] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1468.301194] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1468.301194] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1468.301330] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('513f9fc9-fb62-455e-82a3-541765c9b912',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1468.729462] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1468.729741] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1468.803230] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('513f9fc9-fb62-455e-82a3-541765c9b912',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1469.306038] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 513f9fc9-fb62-455e-82a3-541765c9b912: rpc.has_security_group_logging(os_id): False [ 1469.323746] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1469.324058] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1469.324058] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1469.324234] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1469.324331] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1469.324598] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1469.324742] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1469.324800] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1469.324904] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1469.324980] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1469.325082] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 513f9fc9-fb62-455e-82a3-541765c9b912 is going to be updated. [ 1469.389820] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1469.390101] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1469.390101] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1469.390252] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1469.390403] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1469.403174] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 513f9fc9-fb62-455e-82a3-541765c9b912 in Status: IN_PROGRESS for 2s [ 1471.418505] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 513f9fc9-fb62-455e-82a3-541765c9b912 in Status: SUCCESS [ 1471.418849] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1473.731140] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1473.731577] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1478.732797] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1478.733330] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1482.035145] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.035665] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1482.035665] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1482.035665] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1482.035829] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1482.538792] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1483.041051] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1483.543814] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1483.544044] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1483.734210] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1483.734449] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1484.343639] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.344073] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1484.344073] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1484.344073] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1484.480158] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1484.481038] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1484.482098] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1484.528214] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.528451] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1484.528451] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1484.528619] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1484.541686] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1484.542485] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1484.542572] env[62842]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=62842) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1484.542650] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1484.571808] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.571987] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1484.571987] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1484.572163] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1484.572809] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1484.572952] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1484.647763] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.648049] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1484.648049] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1484.648236] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1484.648530] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1484.648808] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1484.722265] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.722519] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1484.722519] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1484.722685] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1484.723012] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1484.723302] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:26. [ 1484.723397] env[62842]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'32ffe6c8-3c43-4477-ba28-405c32ea0087', 'bc98288b-6b97-448c-a5b8-54058cb0d341', '2d753783-8988-4639-a0fc-596bf03e413b', 'c59f85b7-500a-400b-bef3-55b5e589248f', '72454528-d410-48ed-92f0-27b44c9abb61', '5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4', '3a595937-aa58-40f8-a3cf-b57a814011e8', '017b2ee9-30e5-4870-86c3-53c03de20d66', '102e4bfe-92ec-41e7-859f-253e7a405698', '16baecd6-bda3-40e1-98ef-4e238a3fc354', '9fae61ec-a635-4e29-b840-9933a22bfbe3', '074be4e0-ffc9-4ec9-b29a-40406844218c', 'd014d213-d805-403a-bcc9-8c66da8eefa2', '513f9fc9-fb62-455e-82a3-541765c9b912', '1648554a-7f11-49bf-b9b2-6edf888e2ce9', '1669144b-ae4c-489e-95db-13be5c3bfb22', 'e509406e-18a0-4842-8350-5830bdc3ec79', '534d1af9-5f3d-417d-8cb4-3116f2425761', '789b6627-9a06-47bb-b607-d6625f262f66', 'e7acb0f4-6157-4a0c-977e-ee6a2808aa0e', '5704e4e3-8211-4e30-b474-06c668cf060d', '217e8514-093a-4d74-b378-a5091c69f5ba', '6588f3bb-b208-4ec7-8a50-1e573d683f24', 'cc5a6992-df9c-4f7d-9ebd-4b465ab3ad37', '03708cfa-ea22-40d4-8c09-177242e076fa', 'a28c97db-60c3-43e3-8413-1620ac6f1f6d'} {{(pid=62842) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1484.723488] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1484.741021] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.741240] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1484.741284] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1484.741546] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1484.741644] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1484.741759] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1484.741861] env[62842]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=62842) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1484.741955] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1484.817159] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1484.817458] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1484.817458] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1484.817591] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1484.818684] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1484.818946] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1484.819036] env[62842]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=62842) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1484.819110] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1484.819172] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1484.819250] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/26 resources of Type:Security Group Rules [ 1484.819320] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 32ffe6c8-3c43-4477-ba28-405c32ea0087 with Priority: HIGH for action security_group_rules [ 1484.819396] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bc98288b-6b97-448c-a5b8-54058cb0d341 with Priority: HIGH for action security_group_rules [ 1484.819455] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2d753783-8988-4639-a0fc-596bf03e413b with Priority: HIGH for action security_group_rules [ 1484.819521] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c59f85b7-500a-400b-bef3-55b5e589248f with Priority: HIGH for action security_group_rules [ 1484.819576] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 72454528-d410-48ed-92f0-27b44c9abb61 with Priority: HIGH for action security_group_rules [ 1484.819630] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 with Priority: HIGH for action security_group_rules [ 1484.819689] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 with Priority: HIGH for action security_group_rules [ 1484.819749] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 017b2ee9-30e5-4870-86c3-53c03de20d66 with Priority: HIGH for action security_group_rules [ 1484.819800] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 102e4bfe-92ec-41e7-859f-253e7a405698 with Priority: HIGH for action security_group_rules [ 1484.819850] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 16baecd6-bda3-40e1-98ef-4e238a3fc354 with Priority: HIGH for action security_group_rules [ 1484.819904] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9fae61ec-a635-4e29-b840-9933a22bfbe3 with Priority: HIGH for action security_group_rules [ 1484.819957] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 074be4e0-ffc9-4ec9-b29a-40406844218c with Priority: HIGH for action security_group_rules [ 1484.820018] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d014d213-d805-403a-bcc9-8c66da8eefa2 with Priority: HIGH for action security_group_rules [ 1484.820075] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 513f9fc9-fb62-455e-82a3-541765c9b912 with Priority: HIGH for action security_group_rules [ 1484.820130] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1648554a-7f11-49bf-b9b2-6edf888e2ce9 with Priority: HIGH for action security_group_rules [ 1484.820187] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1669144b-ae4c-489e-95db-13be5c3bfb22 with Priority: HIGH for action security_group_rules [ 1484.820247] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e509406e-18a0-4842-8350-5830bdc3ec79 with Priority: HIGH for action security_group_rules [ 1484.820303] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 534d1af9-5f3d-417d-8cb4-3116f2425761 with Priority: HIGH for action security_group_rules [ 1484.820358] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 789b6627-9a06-47bb-b607-d6625f262f66 with Priority: HIGH for action security_group_rules [ 1484.820416] env[62842]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e with Priority: HIGH for action security_group_rules [ 1484.820506] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1488.735617] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1488.736077] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1488.736077] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32ffe6c8-3c43-4477-ba28-405c32ea0087 with Priority: HIGH for action security_group_rules [ 1488.736077] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d753783-8988-4639-a0fc-596bf03e413b with Priority: HIGH for action security_group_rules [ 1488.736077] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 with Priority: HIGH for action security_group_rules [ 1488.736299] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1648554a-7f11-49bf-b9b2-6edf888e2ce9 with Priority: HIGH for action security_group_rules [ 1488.736299] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e with Priority: HIGH for action security_group_rules [ 1488.736370] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 789b6627-9a06-47bb-b607-d6625f262f66 with Priority: HIGH for action security_group_rules [ 1488.736435] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 534d1af9-5f3d-417d-8cb4-3116f2425761 with Priority: HIGH for action security_group_rules [ 1488.736522] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e509406e-18a0-4842-8350-5830bdc3ec79 with Priority: HIGH for action security_group_rules [ 1488.736967] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 513f9fc9-fb62-455e-82a3-541765c9b912 with Priority: HIGH for action security_group_rules [ 1488.737095] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1669144b-ae4c-489e-95db-13be5c3bfb22 with Priority: HIGH for action security_group_rules [ 1488.737194] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d014d213-d805-403a-bcc9-8c66da8eefa2 with Priority: HIGH for action security_group_rules [ 1488.737288] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 074be4e0-ffc9-4ec9-b29a-40406844218c with Priority: HIGH for action security_group_rules [ 1488.737388] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fae61ec-a635-4e29-b840-9933a22bfbe3 with Priority: HIGH for action security_group_rules [ 1488.737488] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16baecd6-bda3-40e1-98ef-4e238a3fc354 with Priority: HIGH for action security_group_rules [ 1488.737576] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 102e4bfe-92ec-41e7-859f-253e7a405698 with Priority: HIGH for action security_group_rules [ 1488.737666] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 with Priority: HIGH for action security_group_rules [ 1488.737754] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 017b2ee9-30e5-4870-86c3-53c03de20d66 with Priority: HIGH for action security_group_rules [ 1488.737841] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72454528-d410-48ed-92f0-27b44c9abb61 with Priority: HIGH for action security_group_rules [ 1488.737927] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc98288b-6b97-448c-a5b8-54058cb0d341 with Priority: HIGH for action security_group_rules [ 1488.738019] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c59f85b7-500a-400b-bef3-55b5e589248f with Priority: HIGH for action security_group_rules [ 1488.738359] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32ffe6c8-3c43-4477-ba28-405c32ea0087 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1488.738490] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32ffe6c8-3c43-4477-ba28-405c32ea0087" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.738554] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32ffe6c8-3c43-4477-ba28-405c32ea0087" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1488.738761] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32ffe6c8-3c43-4477-ba28-405c32ea0087" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1488.738841] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32ffe6c8-3c43-4477-ba28-405c32ea0087',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1488.739799] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d753783-8988-4639-a0fc-596bf03e413b taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1488.739930] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d753783-8988-4639-a0fc-596bf03e413b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.739975] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d753783-8988-4639-a0fc-596bf03e413b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1488.740145] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d753783-8988-4639-a0fc-596bf03e413b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1488.740219] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d753783-8988-4639-a0fc-596bf03e413b',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1488.740956] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a595937-aa58-40f8-a3cf-b57a814011e8 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1488.741073] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.741138] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1488.741275] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1488.741333] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a595937-aa58-40f8-a3cf-b57a814011e8',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1488.742123] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1648554a-7f11-49bf-b9b2-6edf888e2ce9 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1488.742244] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1648554a-7f11-49bf-b9b2-6edf888e2ce9" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.742292] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1648554a-7f11-49bf-b9b2-6edf888e2ce9" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1488.742464] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1648554a-7f11-49bf-b9b2-6edf888e2ce9" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1488.742534] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1648554a-7f11-49bf-b9b2-6edf888e2ce9',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1488.743237] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1488.743302] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.743382] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1488.743502] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1488.743653] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7acb0f4-6157-4a0c-977e-ee6a2808aa0e',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1488.744321] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-789b6627-9a06-47bb-b607-d6625f262f66 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1488.744481] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-789b6627-9a06-47bb-b607-d6625f262f66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.744545] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-789b6627-9a06-47bb-b607-d6625f262f66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1488.744648] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-789b6627-9a06-47bb-b607-d6625f262f66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1488.744714] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('789b6627-9a06-47bb-b607-d6625f262f66',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1488.745402] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-534d1af9-5f3d-417d-8cb4-3116f2425761 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1488.745505] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-534d1af9-5f3d-417d-8cb4-3116f2425761" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.745571] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-534d1af9-5f3d-417d-8cb4-3116f2425761" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1488.745717] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-534d1af9-5f3d-417d-8cb4-3116f2425761" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1488.746037] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('534d1af9-5f3d-417d-8cb4-3116f2425761',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1488.746807] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e509406e-18a0-4842-8350-5830bdc3ec79 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1488.746909] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e509406e-18a0-4842-8350-5830bdc3ec79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.746973] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e509406e-18a0-4842-8350-5830bdc3ec79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1488.747135] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e509406e-18a0-4842-8350-5830bdc3ec79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1488.747229] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e509406e-18a0-4842-8350-5830bdc3ec79',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1488.747857] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-513f9fc9-fb62-455e-82a3-541765c9b912 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1488.747952] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.748041] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1488.748174] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1488.748237] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('513f9fc9-fb62-455e-82a3-541765c9b912',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1488.748890] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1669144b-ae4c-489e-95db-13be5c3bfb22 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1488.748992] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1669144b-ae4c-489e-95db-13be5c3bfb22" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.749084] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1669144b-ae4c-489e-95db-13be5c3bfb22" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1488.749210] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1669144b-ae4c-489e-95db-13be5c3bfb22" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1488.749276] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1669144b-ae4c-489e-95db-13be5c3bfb22',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1488.750021] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d014d213-d805-403a-bcc9-8c66da8eefa2 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1488.750125] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.750190] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1488.750390] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1488.750390] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d014d213-d805-403a-bcc9-8c66da8eefa2',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1488.751051] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-074be4e0-ffc9-4ec9-b29a-40406844218c taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1488.751159] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.751218] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1488.751398] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1488.751461] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('074be4e0-ffc9-4ec9-b29a-40406844218c',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1488.752151] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9fae61ec-a635-4e29-b840-9933a22bfbe3 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1488.752397] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9fae61ec-a635-4e29-b840-9933a22bfbe3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.752397] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9fae61ec-a635-4e29-b840-9933a22bfbe3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1488.752529] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9fae61ec-a635-4e29-b840-9933a22bfbe3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1488.752582] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9fae61ec-a635-4e29-b840-9933a22bfbe3',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1488.754560] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16baecd6-bda3-40e1-98ef-4e238a3fc354 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1488.754669] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16baecd6-bda3-40e1-98ef-4e238a3fc354" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.754721] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16baecd6-bda3-40e1-98ef-4e238a3fc354" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1488.754873] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16baecd6-bda3-40e1-98ef-4e238a3fc354" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1488.754947] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16baecd6-bda3-40e1-98ef-4e238a3fc354',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1488.755628] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-102e4bfe-92ec-41e7-859f-253e7a405698 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1488.755735] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-102e4bfe-92ec-41e7-859f-253e7a405698" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.755800] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-102e4bfe-92ec-41e7-859f-253e7a405698" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1488.755949] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-102e4bfe-92ec-41e7-859f-253e7a405698" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1488.756032] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('102e4bfe-92ec-41e7-859f-253e7a405698',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1488.756686] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1488.756784] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.756850] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1488.756994] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1488.757076] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1488.757723] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-017b2ee9-30e5-4870-86c3-53c03de20d66 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1488.757817] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-017b2ee9-30e5-4870-86c3-53c03de20d66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.757884] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-017b2ee9-30e5-4870-86c3-53c03de20d66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1488.758050] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-017b2ee9-30e5-4870-86c3-53c03de20d66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1488.758122] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('017b2ee9-30e5-4870-86c3-53c03de20d66',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1488.758838] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72454528-d410-48ed-92f0-27b44c9abb61 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1488.758942] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72454528-d410-48ed-92f0-27b44c9abb61" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.759011] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72454528-d410-48ed-92f0-27b44c9abb61" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1488.759160] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72454528-d410-48ed-92f0-27b44c9abb61" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1488.759228] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72454528-d410-48ed-92f0-27b44c9abb61',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1488.759870] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc98288b-6b97-448c-a5b8-54058cb0d341 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1488.759974] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc98288b-6b97-448c-a5b8-54058cb0d341" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.760043] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc98288b-6b97-448c-a5b8-54058cb0d341" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1488.760194] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc98288b-6b97-448c-a5b8-54058cb0d341" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1488.760265] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc98288b-6b97-448c-a5b8-54058cb0d341',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1488.760904] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c59f85b7-500a-400b-bef3-55b5e589248f taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1488.761029] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c59f85b7-500a-400b-bef3-55b5e589248f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1488.761077] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c59f85b7-500a-400b-bef3-55b5e589248f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1488.761226] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c59f85b7-500a-400b-bef3-55b5e589248f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1488.761297] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c59f85b7-500a-400b-bef3-55b5e589248f',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1489.266394] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-513f9fc9-fb62-455e-82a3-541765c9b912 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.266634] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.266634] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1489.266753] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1489.266916] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.267028] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.267094] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1489.267237] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1489.267320] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1489.267407] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1489.267535] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('513f9fc9-fb62-455e-82a3-541765c9b912',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1489.289204] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('513f9fc9-fb62-455e-82a3-541765c9b912',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1489.301103] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 513f9fc9-fb62-455e-82a3-541765c9b912: rpc.has_security_group_logging(os_id): False [ 1489.342127] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.342392] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.342392] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1489.342569] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1489.344275] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.344407] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.345144] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.345240] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.345973] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.346087] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.346850] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.346947] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.347655] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.347753] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.348780] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.348876] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.349536] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.349630] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.350336] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.350433] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.351146] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.351238] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.352785] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.352881] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.353501] env[62842]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1489.353912] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.354015] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.354668] env[62842]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1489.355073] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.355178] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.356172] env[62842]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1489.356608] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.356743] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.359126] env[62842]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1489.359555] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.359652] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.361607] env[62842]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1489.362046] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.362160] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.362784] env[62842]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1489.363219] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.363333] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.363971] env[62842]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1489.364446] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.364556] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.365194] env[62842]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1489.365606] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.365715] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.366394] env[62842]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1489.366831] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1489.366986] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16baecd6-bda3-40e1-98ef-4e238a3fc354 is going to be deleted. [ 1489.368486] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.368572] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.368608] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1489.368823] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1489.385899] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1489.386050] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 102e4bfe-92ec-41e7-859f-253e7a405698 is going to be deleted. [ 1489.386857] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1489.387115] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1489.407338] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1489.407512] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 534d1af9-5f3d-417d-8cb4-3116f2425761 is going to be deleted. [ 1489.408348] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1489.408556] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1489.431250] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.431474] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.438695] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1489.438851] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1648554a-7f11-49bf-b9b2-6edf888e2ce9 is going to be deleted. [ 1489.439720] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1489.439964] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1489.441414] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.441521] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.458787] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1489.458961] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4 is going to be deleted. [ 1489.459803] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1489.460026] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1489.462057] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.462179] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.491096] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1489.491287] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32ffe6c8-3c43-4477-ba28-405c32ea0087 is going to be deleted. [ 1489.492162] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1489.492410] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1489.520422] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.520620] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.529394] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1489.529565] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c59f85b7-500a-400b-bef3-55b5e589248f is going to be deleted. [ 1489.530580] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1489.530806] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1489.565252] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.565481] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.585867] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1489.586065] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a595937-aa58-40f8-a3cf-b57a814011e8 is going to be deleted. [ 1489.586953] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1489.587179] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1489.611389] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.611644] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.619508] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1489.619664] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 074be4e0-ffc9-4ec9-b29a-40406844218c is going to be deleted. [ 1489.620558] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1489.620772] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1489.646095] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.646306] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.663424] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1489.663630] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d014d213-d805-403a-bcc9-8c66da8eefa2 is going to be deleted. [ 1489.664545] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1489.664761] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1489.738644] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1489.739141] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d753783-8988-4639-a0fc-596bf03e413b is going to be deleted. [ 1489.739729] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1489.739949] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1489.743128] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.743278] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.755658] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.755899] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.785479] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1489.785479] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc98288b-6b97-448c-a5b8-54058cb0d341 is going to be deleted. [ 1489.786468] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1489.786680] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1489.837781] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1489.838051] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1669144b-ae4c-489e-95db-13be5c3bfb22 is going to be deleted. [ 1489.838886] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1489.839082] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1489.862224] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.862502] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.911302] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.911550] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.912387] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1489.912673] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.912757] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.912823] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1489.913041] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1489.913128] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1489.913222] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 513f9fc9-fb62-455e-82a3-541765c9b912 is going to be updated. [ 1489.914275] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1489.914483] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1489.951868] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.952174] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1489.960267] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1489.960413] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72454528-d410-48ed-92f0-27b44c9abb61 is going to be deleted. [ 1489.961394] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1489.961611] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1489.996152] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1489.996384] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1490.032589] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.032760] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 017b2ee9-30e5-4870-86c3-53c03de20d66 is going to be deleted. [ 1490.033698] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.033913] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.090554] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1490.090833] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1490.093493] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.093627] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e509406e-18a0-4842-8350-5830bdc3ec79 is going to be deleted. [ 1490.094611] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.094821] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.150495] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.150627] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9fae61ec-a635-4e29-b840-9933a22bfbe3 is going to be deleted. [ 1490.151949] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.152190] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.191799] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1490.192026] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1490.201668] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1490.201958] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1490.226849] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.227053] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7acb0f4-6157-4a0c-977e-ee6a2808aa0e is going to be deleted. [ 1490.227913] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.228146] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.228234] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.228366] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16baecd6-bda3-40e1-98ef-4e238a3fc354" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.228529] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.228687] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.228766] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.228888] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-102e4bfe-92ec-41e7-859f-253e7a405698" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.229428] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.229594] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.229674] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.229789] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-534d1af9-5f3d-417d-8cb4-3116f2425761" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.229917] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.230106] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.230184] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.230292] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1648554a-7f11-49bf-b9b2-6edf888e2ce9" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.230418] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.230563] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.230638] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.230747] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b879be5-973c-4a9c-b9f1-a6fbd7b26cf4" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.230869] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.231015] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.231099] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.231209] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32ffe6c8-3c43-4477-ba28-405c32ea0087" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.231342] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.231484] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.231555] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.231665] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c59f85b7-500a-400b-bef3-55b5e589248f" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.231788] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.231926] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.231999] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.232121] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a595937-aa58-40f8-a3cf-b57a814011e8" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.232242] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.232400] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.232480] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.232588] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-074be4e0-ffc9-4ec9-b29a-40406844218c" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.232716] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.232860] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.232918] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.233040] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d014d213-d805-403a-bcc9-8c66da8eefa2" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.233167] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.233303] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.233372] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.233480] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d753783-8988-4639-a0fc-596bf03e413b" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.233603] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.233738] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.275885] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.276091] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 789b6627-9a06-47bb-b607-d6625f262f66 is going to be deleted. [ 1490.276987] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.277222] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.277313] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.277436] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc98288b-6b97-448c-a5b8-54058cb0d341" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.277604] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.277757] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.277852] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.277942] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1669144b-ae4c-489e-95db-13be5c3bfb22" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.278543] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.278724] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.278925] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.279937] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.280111] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.280194] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.280307] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72454528-d410-48ed-92f0-27b44c9abb61" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.280450] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.280591] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.280666] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.280776] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-017b2ee9-30e5-4870-86c3-53c03de20d66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.296928] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1490.297181] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1490.297271] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.297471] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.297588] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.297739] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e509406e-18a0-4842-8350-5830bdc3ec79" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.309566] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1490.309749] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1490.309749] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.309952] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.310051] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.310162] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9fae61ec-a635-4e29-b840-9933a22bfbe3" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.338401] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 513f9fc9-fb62-455e-82a3-541765c9b912 in Status: IN_PROGRESS for 2s [ 1490.374158] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1490.374366] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1490.374366] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.374580] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.374664] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.374783] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7acb0f4-6157-4a0c-977e-ee6a2808aa0e" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.425720] env[62842]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1490.426372] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1490.426567] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1490.426567] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1490.426792] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1490.426971] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.427143] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-789b6627-9a06-47bb-b607-d6625f262f66" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1492.353701] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 513f9fc9-fb62-455e-82a3-541765c9b912 in Status: SUCCESS [ 1492.354106] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1493.738697] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1493.739104] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1498.740373] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1498.740373] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1503.741019] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1503.741433] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1508.742698] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1508.743110] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1513.744142] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1513.744591] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1518.745690] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1518.745690] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1523.746801] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1523.747286] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1528.748311] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1528.748311] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1533.749316] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1533.749316] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1535.624859] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock network-246 taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.625241] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "network-246" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.625241] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "network-246" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1535.625453] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "network-246" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1535.625732] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.625920] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.626055] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1535.626276] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1535.626428] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1535.626638] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1535.626767] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] NeedRegenerationException {{(pid=62842) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1535.626880] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] no value, waiting for create lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1535.626991] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] value creation lock acquired {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1535.627117] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] No value present for key: 'zone-id' {{(pid=62842) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1535.627227] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Calling creation function for not-yet-present value {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1535.627363] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1535.677100] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1535.677320] env[62842]: DEBUG dogpile.cache.region [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Cache value generated in 0.050 seconds for key(s): 'zone-id' {{(pid=62842) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1535.677426] env[62842]: DEBUG dogpile.lock [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Released creation lock {{(pid=62842) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1535.677616] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "network-246" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1535.677958] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock port-8b5c141e-6bbe-4781-812a-2bc4061c2f7d taken with stack trace [, , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.678169] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "port-8b5c141e-6bbe-4781-812a-2bc4061c2f7d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.678295] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "port-8b5c141e-6bbe-4781-812a-2bc4061c2f7d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1535.678563] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "port-8b5c141e-6bbe-4781-812a-2bc4061c2f7d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1535.678711] env[62842]: DEBUG networking_nsxv3.api.rpc [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b5c141e-6bbe-4781-812a-2bc4061c2f7d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1536.181603] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.181891] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.182089] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.182308] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.182466] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.182805] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.182974] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.183111] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.183338] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.183485] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.183781] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.183954] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.184087] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.184300] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.184438] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.184581] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Resource: SegmentPort with ID: 8b5c141e-6bbe-4781-812a-2bc4061c2f7d is going to be updated. [ 1536.210171] env[62842]: DEBUG networking_nsxv3.common.locking [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.210418] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.210518] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.210797] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.211008] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.211258] env[62842]: DEBUG oslo_concurrency.lockutils [None req-7b2f5ed3-8632-43c8-b822-20cadaecbd52 None None] Releasing lock "port-8b5c141e-6bbe-4781-812a-2bc4061c2f7d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.860928] env[62842]: INFO networking_nsxv3.common.synchronization [req-a521c914-5752-45dd-a9c4-0b7b33f1fd04 req-8f7a9320-c6e2-42e4-b0bb-8c3e39a8d188 service nova] Enqueued Resource ID: 513f9fc9-fb62-455e-82a3-541765c9b912 with Priority: HIGHEST for action security_group_rules [ 1536.861254] env[62842]: INFO networking_nsxv3.common.synchronization [req-a521c914-5752-45dd-a9c4-0b7b33f1fd04 req-8f7a9320-c6e2-42e4-b0bb-8c3e39a8d188 service nova] Enqueued Resource ID: 513f9fc9-fb62-455e-82a3-541765c9b912 with Priority: HIGHEST for action security_group_members [ 1536.861387] env[62842]: INFO networking_nsxv3.common.synchronization [req-a521c914-5752-45dd-a9c4-0b7b33f1fd04 req-8f7a9320-c6e2-42e4-b0bb-8c3e39a8d188 service nova] Enqueued Resource ID: 8b5c141e-6bbe-4781-812a-2bc4061c2f7d with Priority: HIGHEST for action port [ 1536.861498] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 513f9fc9-fb62-455e-82a3-541765c9b912 with Priority: HIGHEST for action security_group_rules [ 1536.861629] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 513f9fc9-fb62-455e-82a3-541765c9b912 with Priority: HIGHEST for action security_group_members [ 1536.861725] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b5c141e-6bbe-4781-812a-2bc4061c2f7d with Priority: HIGHEST for action port [ 1536.863647] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock rules-513f9fc9-fb62-455e-82a3-541765c9b912 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.863647] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.863647] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.863647] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.863647] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('513f9fc9-fb62-455e-82a3-541765c9b912',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1536.863647] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-513f9fc9-fb62-455e-82a3-541765c9b912 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.864264] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.864264] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.864264] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.864264] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.864264] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.864264] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.864489] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.864489] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.864558] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('513f9fc9-fb62-455e-82a3-541765c9b912',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1536.865278] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock port-8b5c141e-6bbe-4781-812a-2bc4061c2f7d taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.865377] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8b5c141e-6bbe-4781-812a-2bc4061c2f7d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.866979] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8b5c141e-6bbe-4781-812a-2bc4061c2f7d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.866979] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8b5c141e-6bbe-4781-812a-2bc4061c2f7d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.866979] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b5c141e-6bbe-4781-812a-2bc4061c2f7d',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1537.367987] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('513f9fc9-fb62-455e-82a3-541765c9b912',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1537.369037] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-513f9fc9-fb62-455e-82a3-541765c9b912 taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.369221] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.369494] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8b5c141e-6bbe-4781-812a-2bc4061c2f7d with status ACTIVE [ 1537.369656] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.369766] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.369829] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.370045] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.370161] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.370294] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.370406] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.370451] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.370599] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.370663] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.370846] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.370926] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.371065] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.371155] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.371208] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.371283] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8b5c141e-6bbe-4781-812a-2bc4061c2f7d is going to be updated. [ 1537.393461] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.393800] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.393800] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.393942] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.393996] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.394144] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8b5c141e-6bbe-4781-812a-2bc4061c2f7d" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.870102] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('513f9fc9-fb62-455e-82a3-541765c9b912',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1538.372838] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1538.373158] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1538.373158] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1538.373312] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1538.373362] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1538.373462] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 513f9fc9-fb62-455e-82a3-541765c9b912 is going to be updated. [ 1538.416501] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1538.416806] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1538.416806] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1538.417040] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1538.417179] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1538.428840] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 513f9fc9-fb62-455e-82a3-541765c9b912 in Status: IN_PROGRESS for 2s [ 1540.440086] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 513f9fc9-fb62-455e-82a3-541765c9b912 in Status: SUCCESS [ 1540.440507] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.440507] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.440619] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.440763] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1540.440916] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1540.440979] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.441168] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.441247] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.441331] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.441422] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('513f9fc9-fb62-455e-82a3-541765c9b912',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1540.943838] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('513f9fc9-fb62-455e-82a3-541765c9b912',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1541.446516] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 513f9fc9-fb62-455e-82a3-541765c9b912: rpc.has_security_group_logging(os_id): False [ 1541.468306] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.468541] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.468541] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.468732] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.468810] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1541.469082] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.469200] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.469257] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.469402] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.469488] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1541.469696] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 513f9fc9-fb62-455e-82a3-541765c9b912 is going to be updated. [ 1541.534582] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.534842] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.534842] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.535053] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.535184] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1541.552577] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 513f9fc9-fb62-455e-82a3-541765c9b912 in Status: IN_PROGRESS for 2s [ 1541.862893] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1541.863094] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1543.573452] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 513f9fc9-fb62-455e-82a3-541765c9b912 in Status: SUCCESS [ 1543.573800] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.864415] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1546.864945] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1551.865823] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1551.866213] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1553.027706] env[62842]: INFO networking_nsxv3.common.synchronization [req-80ccbbcb-b501-4a1a-b689-bdb9696e1e93 req-4a8ff070-1cdd-429e-b703-8e58d8c48956 tempest-ServerActionsTestOtherB-1524579062 tempest-ServerActionsTestOtherB-1524579062-project-member] Enqueued Resource ID: 513f9fc9-fb62-455e-82a3-541765c9b912 with Priority: HIGHEST for action security_group_members [ 1553.028384] env[62842]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 513f9fc9-fb62-455e-82a3-541765c9b912 with Priority: HIGHEST for action security_group_members [ 1553.028760] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock member-513f9fc9-fb62-455e-82a3-541765c9b912 taken with stack trace [, , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.028939] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.029066] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.029383] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.029545] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.029648] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.029705] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.029872] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.029957] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.030067] env[62842]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('513f9fc9-fb62-455e-82a3-541765c9b912',) {} {{(pid=62842) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1553.532545] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.532812] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.532812] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.532975] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.533093] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.533288] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.533385] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.533444] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.533589] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.533664] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.533748] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 513f9fc9-fb62-455e-82a3-541765c9b912 is going to be updated. [ 1553.568177] env[62842]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=62842) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.568410] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.568410] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.568569] env[62842]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.568714] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.578391] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 513f9fc9-fb62-455e-82a3-541765c9b912 in Status: IN_PROGRESS for 2s [ 1555.590815] env[62842]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 513f9fc9-fb62-455e-82a3-541765c9b912 in Status: SUCCESS [ 1555.591216] env[62842]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 513f9fc9-fb62-455e-82a3-541765c9b912 deletion is rescheduled due to dependency. [ 1555.591216] env[62842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-513f9fc9-fb62-455e-82a3-541765c9b912" {{(pid=62842) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1558.029515] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1558.029941] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1563.031119] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1563.031305] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1568.032542] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1568.032963] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1573.033891] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1573.034279] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1578.034997] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1578.035334] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1583.036467] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1583.036800] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1588.038072] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1588.038524] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1593.039416] env[62842]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1593.039746] env[62842]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0